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PREFACE 



The areas of licensing and accrediting have been difficult areas since the 
two concepts were invented in the late 19th century. On the one hand, the 
state, under the concept of "licensing" or "credentialling," claims to protect 
the public safety by providing the public with competent practitioners; on 
the other hand, spokesmen for public interest groups have often claimed that 
licensing, like all forms of government regulation, serves the interest of what- 
ever establishment is licensed more than the public interest. The area of 
licensing is further complicated by the fact that, in many fields, licensing is 
attached to accreditation— that is, a degree in a field from an accredited 
college often means that the degree recipient automatically receives a license 
to practice in the field upon application to the state. 

The field of accreditation has been complicated by recent litigation 
claiming that accreditation agencies are in violation of the antitrust acts and 
recent quasi-legal action of the Federal Commission on Accreditation and 
Eligibility calling into question the carefulness and adequacy of the accredita- 
tion actions cf several of the agencies. If a license is issued on the basis of an 
accreditation and the accreditation unit is no good, how can the license be 
good? Even if the accreditation visit is careful, does that mean that the 
accredited institution can promise that all of those who march from its doors 
can do a good job? 

The determining of "who can do a good job" has also become central 
in civil rights litigation since the Griggs^case. Now the more common indus- 
trial and business jobs require job desCnpfions, and employers have to be able 
to show that the employees whom they hire actually have the skills required 
by the job description. They, in some cases, need to show that they have 
ranked candidates for employment according to objective evidence showing 
the degree to which each candidate is suited for the job. That, at least, be- 
came the responsibility of the employer if challenged by a minority employee 
who claimed prejudice in, say, a company's personnel department. 

Numerous cases have been litigated successfully, in the commoner 
trades and occupations, under the Griggs decision and EEOC applications of 
it. Now Griggs is be^nning to be applied to jobs traditionally regarded as 
•more sophisticated' such as the school principal's job or the teacher'^ job. 

V 
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All of this comes to a head in the conduct of education professions. 
Here accreditation is attached to licensing, both licensing and accreditation 
axe under attack, various schemes for licensing which purport to tell us which 
people can ''do which jobs" (CBTE, PBTE, etc.) axe being developed. And it 
is hard to claim in some cases that the "public interest" has been protected 
by the licensing process, particularly in minority settings where other than 
the English language is spoken. The courts recently ruled that children must 
be taught, at least in the early grades, by teachers speaking their language. 
And yet 'English language-speaking teachers have been licensed and given 
jobs in schools having predominantly non-English-speaking students for * 
decades. 

Recent studies show that the quality of the school staff, its fitness to 
the context in which it works, does make a difference to learning, to the 
success of desegregation policy, to drop-outs, to the emotional well-being of 
children~io many matters in which the state and the public have an interest, 

I believe that we must meet the criteria of the Griggs decision and the 
EECX^ gmdelines in the education professions; we must have standards of 
employment which meet their norms-whether minorities are job applicants 
or not. Hence I encouraged the reports and conference summarized here. 

Originally when Donald Bigelow and I asked the Study Commission on 
Undergraduate Education and the Education of Teachers to come into exist- 
ence, we asked that it look at accreditation and licensing in the education 
professions. Since then the Commission has carried the job of scrutiny ahead 
a good deal so that we now know that some forms of licensing of teachers 
indifferent to Griggs or to the child's culture, some forms of accreditation 
indifferent to due process, will not go down at the federal or state level. 1 
now have asked the Study Commission to secure the best information avail- 
able as to: 

1 . How can we find out what the job of teaching is and determine in 
specific contexts what people are ready to do it; 

2. What constitutes education for teaching competence (or for 
competence of any kind), and what are its pitfalls; 

3. What does the law say, and what is it likely to say, about what is 

vi 
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requisite to a validated credential for a teacher; 



4. What constitutes due process and valid slate action in the accre- 
diting of teacher education. 

The conference recorded here struggles vigorously with these four qvMistions. 
I commend it to the attention of state and federal officials, of peoph in the 
education professions, and of the public at large. 

William Smith 
Director, Teacher Corps 
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INTRODUCTION 



Any licensing process, if it is to serve the public interest, has to be 
clear, has to be just and perceived to be just, and has to be validated-that is, 
there has to be some evidence that people who are licensed are people who 
can do the job. Teacher licensing, developed in this country as one of the 
took throu^ which the state exercises its police powers in protecting the 
general welfare, is the focus of this volume. 

A long line of court cases has established that as a general 
matter an individual caimot be hired and paid as a teacher or 
supervisor by a local school system without prior certification or 
licensing. Courts consistently tend to uphold the state's preroga- 
tive to exercise its police power and limit the profession of teach- 
ing to those who meet prescribed criteria. Presumably the estab- 
lishment of such policies by the states, and the courts' affirma- 
tion of such policies as state responsibility/, are intended to 
protect the general welfare. The point of the courts' decisions . . . 
is that licensing is a state responsibility, undertaken to insure high 
teaching standards at the local level— on the assumption that 
state officials know what constitutes good teaching at the local 
level 

But like most other occupational licensing mechanisms, 
those developed for the teaching profession appear to have 
emerged haphazardly. . . . Ehjring the past seventy-five years a 
system which originally placed responsibility for licensing of 
teachers in some three thousand local licensing authorities has 
been reduced to the fifty state systems and a handful of large 
city school districts, such as New York City and Chicago, which 
retain special authority. ... 

The present general or qualitative requirements for licen- 
sure as a teacher (elementary or secondary) appear to be simple 
enough. They art? threefold: (1) typically, the states have citizen- 
ship, health, age, and moral requirements; (2) all states mini- 
mally require a bachelor's degree for certification; (3) about 
eight states also require specialized courses in state history, state 
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and federal governments, agriculture and conservation (however, 
several of these states allow substitution of acceptable scores on 
proficiency exams in lieu of courses). 

The quantitative requirements for licensure also appear at 
first sight to be straightforward. In 1973, the most common 
credit hour requirements for licensure among the various states 
were as follows: 40 to 48 semester hours in "general education" 
for elementary as well as secondary teachers; 18 to 24 semester 
hours in professional education for elementary teachers and be* 
tween 18 and 21 semester hours for secondary teachers. 

The seemingly straightforward nature of these requirements 
may be misleading, however. Most states have adopted an "ap- 
proved program" approach to the licensing procedure to replace 
licensure by a state department transcript analysis to see if one 
has taken the right courses for a license. Program appro /al is 
essentially accreditation. State accreditation is, in turn, related to 
national accreditation. 

Final Report of the Study Commission on Under* 
graduate Education and the Education of Teachers, 
Teacher Education in the United States: The Respon- 
sibility Gap (Lincoln: University of Nebraska Press, 
1976), pp. 102-03. 

Today's accrediting systems make no guarantees as to the quality of a 
teacher. A program is "approved"— that is, sanctioned by various accrediting 
systems (national, regional, state) and indirectly, by professional societies 
(whose members themselves have attained professional status within these 
same systems). But, without more, a vast gap exists between the paper 
standards established by the systems and those criteria which might effect- 
ively determine if our teachers are truly competent to teach. 

Not only have the teaching certification standards ignored the question 
of effective performance, a number of court cases in conjunction with Titte 
VII of the Civil Rights Act of 1964 have specially held that segments of the 
population have in fact been illegally locked out of the education profes- 
sions by present certification procedures or by examination procedures re- 
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latcd to certification. These cases have required licensing officials to revamp 
theii methods and assure that all job requirements are demonstrably related 
to attributes actually needed to perform well on the job. It appears tliat state 
licensing requiements are susceptable to challenge as follows: 

1. The procedures themselves may be attacked as racially or sexu- 
ally discriminatory and hence violative of equal protection and due 
process of law; and 

2. The very foundation for licensing, the accreditation system, may 
be attacked as illicit state action, that is, the imposition by a body poli- 
tic of a system of classification or standards which are not reasonably 
related to the promotion of that as part of the public welfare for which 
they were established. 

The recent challenges to the licensing procedures and content have 
generally been aimed toward protecting the individual's right to equitable 
treatment in hiring, the public interest in the treatment of culture groups, and 
the denigration of the public welfare through the mistreatment of students as 
consumers. The Griggs v. Duke Power Co. decision spoke to discriminatory 
hiring practices. A series of cases followed in the wake of Griggs. Best known 
perhaps is the Chance v. Board of Examiners case, which directed the New 
York City Board of Examiners to revise its principal licensing processes. 
Decisions have seriously questioned the National Teachers* Examination, 
striking it down as a non-job-related or "non-validated" selection instrument. 
A second series of cases, such as Wisconsin v. Yoder and Lau v. Nichols, so- 
called "bicultural cases,'* focused upon group rather than individual welfare. 
These decisions (a) allowed parents and certain cultures to keep their children 
out of the public schools if those schools were somehow destructive to the 
cultural integrity of that group, or (b) required the schools to reflect the 
language and culture of the child— at least in the early grades. • 

An additional type of suit centered upon consumer protection. In the 
Bridgeport suit, a teacher education student sued the University of Bridge- 
port on the grounds that she did not get fair value for her money, her courses 
being useless and impractical. In the Peter Doe case, a student who claimed to 
be unable to read sued the school system which he had attended on the 
grounds that he had been passed along without being taught to read, without 
his parents being warned, and was consequently rendered incapable of func- 
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tioning properly outside the schools. 

The court challenges to the licensing and accreditation procedures have 
resulted in some rather important, if small, changes. The accrediting agencies, 
for example are increasingly describing themselves as protection agencies; 
thus we could expect that eventually consumer protection law will come to 
bear on the treatment of accrediting agencies. Furthermore, the Fund for 
the Improvement of Post -Secondary Education requested that the American 
Research Institute prepare a set of consumer protection guidelines. Students 
have Increasingly demanded a role in the licensing agencies and have sue- 
ceeded in achieving the role in Texas and California. Many states have aban- • 
doneu ihe National Teachers' Examination as a valid test for certification. 

The Carnegie Commission statistics on higher education, gathered in 
1970-71, and analyzed by the Study Commission, reveal thai students then 
at least were saying that their education for the role of teacher was not 
adequate. Sixty-three per cent of the seniors believed that it was essential 
that they get a detailed grasp of a specific field, but only twenty-seven per 
cent have said that they received a detailed grasp. Sixty per cent said that it 
was essential that they get training and skills for an occupation, but twenty 
per cent said they received no training or skills. Yet these twenty per cent 
were, in most cases, licensed to teach in the public schools. In a survey done 
in a South Carolina city, over one half of the new teachers rated their teacher 
education as poor to fair. More than two thirds of the high school teachers 
indicated dissatisfaction with their teacher education courses. Deficiencies in 
their education related to their incapacity to cope with individual and group 
differences, to deal with student emotions, and to organize worthwhile acti- 
vities for students. If the licensing process is to work, it must provide the 
public with teachers who see themselves as prepared to teach where they 
teach and whom the public also sees as competent, fit, ready. (See Study 
Commission Final Report, Teacher Education in the United States: The 
Responsibility Gap, [cited above] for a detailed accounting of the Carnegie 
survey analysis.) 

There is also eviderice that the licensing process is not working very well 
to bring into the profession people who are representative of, and responsive 
to, minority cultures. For example, despite the tremendous impetus of the 
civil rights movement, statistics suggest that the number of black teachers 
now is about the same as ten years ago. The National Education Association 
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and the Office of Civil .Rights both indicated that less than three per cent of 
the students who needed bilingual and bicultural teachers are getting them. 

The essays in this book evolved from the groundwork laid at a confer- 
ence in December, 1975, on the legal implications of competency-based 
teacher education sponsored by the Multi-State Consortium on Performance- 
Based Teacher Education. At that meeting representatives fro^^> ^tnte depn^^ 
ments of education and their legal advisors met with a 
to discuss licensing and accrediting issues, llie issues ra 

1. What does the litigation say about new . » , sensing 
teachers and accrediting teacher education? 

and 

2. What does research say about what can be done to provide com- 
petent practitioners for classrooms and school leadership roles? 

Betty Levitov 

Study Commission on Undergraduate Education 
and the Education of Teachers 



14 



xiii 



THE LAW. THE COURTS. AND TEACHER 



CREDENTIALLING REFORM 



By Michael A, Rebell 

Michael Rebell, a New York attorney and partner in Rebell, Krieger, 
Fischbein, Olivieri, has special interest in education law. He is Special Counsel 
to the New York State Assembly and Adjunct Associate Professor of Law at 
State University of New York at Purchase, New York, Among Rebell's clients 
axe the New York City School Boards Association, the Public Education 
Association, The Organization to Assure Services for Exceptional Students 
aind the Street Academy of New York. As a consultant to the National Study 
Commission on Undergraduate Education and the Education of Teachers, 
Rebell wrote Teacher CredentiaUing Reform in New York' State: A Critique 
and a Suggestion for New Directions, and helped to develop the chapter on 
the licensing and accrediting process in the Study Commission final report, 
Teacher Education in The United States: Tlie Responsibility Gap. 
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THE LAW, THE COURTS, AND TEACHER 
CREDENTIALLING REFORM 

By Michael A. Rebell 



The topic I have been asked to discuss this afternoon is somewhat 
ironic. Gathered together in this room are representatives of education de- 
partments of 13 states which are lead ers in the Competency Based Teacher 
Education ("CBTE") movement, a movement which is in the forefront of 
efforts to reform shortcomings in traditional teacher credentialling systems. 
But, instead of commending you on your reform efforts, my task is to out- 
line criticisms of teacher licensing systems, inr^ ' g CBTE, which plaintiffs 
may shortly be presenting to the courts-n h the courts may be in- 

clined to uphold. Much has been accom] iied in ... of teacher licensing 
reform in the past few years, but, the cc m jrtly be requiring that 
even more be done in years to come. 

My remarks will stress three major themes: first, an analytic overview 
of CBTE from a lawyer's perspective; second, a discussion of some of the 
potential legal challenges to credentialling systems and to CBTE that I see in 
the offing; and third, a preliminary discussion of a design for a valid licensing 
system. Since each of these issues could be discussed for the entire confer- 
ence, obviously, I will only attempt to hit the high points. I will leave some 
time for questions at the conclusion of my talk, and, if sufficient interest 
is generated, these issues can be further explored in more depth in small 
group discussions at a later point in the conference. 

Let us turn then to the first of my three basic points, which is an over- 
view of the legal implications of CBTE. My basic perspective on CBTE has 
been described in some detail in the monograph that I wrote for the Study 
Commission on Undergraduate Education and the Education of Teachers 
two years* ago. ^ The starting point of my argument there was that teacher 
licensing, as it emerged in the 19th century, was mainly concerned with 



Teacher Credentialling Reform in New York State: A Critique and a Suggestion 
for New Directions (SCUEET, University of Nebraska, 1974). 

3 



16 



assuring that elementary school teachers had rudimentary ability in reading, 
writing and arithmetic. It was not difficult at that time for a few states of 
local school districts to engage in examination or other processes to deter' 
mine whether a potential teacher knew how to "read or write or cipher to 
the rule of three," as Abraham Lincoln once put it. 

A dramatic acceleration in both the complexity and rigor of teachef 
education and teacher licensing requirements began toward the end of th^ 
19th century as mass compulsory education became implemented throughout 
the country and the states felt compelled to establish explicit statewide cre' 
dentialling standards that would attest to the competence of the thousands of 
teachers who were now being assigned to the burgeoning new school rooms- 
What was looked for in these credentialling standards was not merely basi^^ 
ability in reading, writing and arithmetic, but also an indication of profici' 
ency in professional techniques and a level of competence in specific subject 
areas. It quickly became apparf^nt tbnt i*' .Icntials were going to be awarded 
largfely on the basis c'' > nrriculum studied at the rapidly 

expanding teacher trairi. , ; autiuai, ii would make sense to allow thes^ 
institutions to, in effect, become the vehicles for implementing the state 
licensing authority, llius developed the widely prevalent "approved progrart^ 
credentialling" system. 

I will not attempt to repeat at this time the criticisms which numerous 
commentators have lodged against traditional approved program credential' 
ling systems, such as the irrelevance or inadequacy of the professional course^ 
* at many teacher training institutions. (I am not sure that the elaborate 
modem credentialling systems have ever really proved capable of measuring 
any more than tlie same basic knowledge of "reading, writing and ciphering'' 
that was tested by the rudimentary 19th century systems). Suffice it to say 
for present purposes that the CBTE reform movement of the 1970's is th^ 
latest manifestation of reform trends which have been attempting for decad^^ 
to recrify the shortconiaii^ of traditional teacher education process. Th^ 
obvious need for reform wws succinctly summanzed^byaoiecent statement of 
the New York State EduoLtion Commissioner, who, in reference to traditiori' 
al teacher education prtmrams, stated that all we -can certify conceming ^ 
graduate of these pro^sns is that he "is not intellectually inadequate an^ 
that he has some suppctaairinterest in teaching," By implication, the Commit' 
sioner was thus indicanu^g that we cannot certify that a graduate of a fouf' 
year program at a teacher training institution, who has been licensed by th^ 

4 



17 



state, is in fact competent to teach or is any more qualified for the profes- 
sion than an individual who did not undertake four years of professional 
training. 

Now that is quite a statement. From a lawyer's point of view, the 
evidentiary value of such an admission by the highest education official in 
New York State is dramatic; the Commissioner is, in essence, admitting that 
the licensing standards which his state has imposed on thousands of people- 
over the years are not capable of ensuring the state and its school children 
that their teachers are qualified. One obviously begins to wonder how these 
licensing standards can be justified or defended. 

Fortunately for New York State, and of course not quite as a matter of 
coincidence, at the time the Commissioner made this statement, the state 
was already reforming its traditional approach and was moving in the direc- 
tion of competency-based teacher education. I will not attempt in this short 
talk to undertake a description or a critique of CBTE, since I assume that 
everybody in this room is basically faniiliJi with the movement's aims and 
methods. In a nutshell, I think the CBTE movement can be said to be at- 
tempting to meet the challenge implied in the Commissioner's statement by 
seeking to create a method of training teachers which will assure that the 
graduates of programs in teacher training institutes have been instructed and 
evaluated in terms of demonstrably relevant teaching "competencies" and are 
therefore, in fact, fully competent to teach. The award of a teacher's certi- 
ficate to a graduate of a CBTE program would thus be a valid indication of a 
high level of professional qualificaiicMK 

Interestingly, the CBTE crogram in: New York State is being imple- 
mented in accordance with a^e^:ific trmetiable promulgated by the Board of 
Regents. A phase-in of CBTE wiuircmemts for newly-registered programs 
began in 1975, but the key date ^faMnamnssts me in that timetable is 1990, 
the year that the state hopesLHasitmiiEi a position to:empirically validate the 
specific teaching "competencies* wajidt tiie various teacher-training insti- 
tutes; are being required to besimmu^zeat the present time. Certainly, if 
in W9Q the state of the art ofeMKSMncntis^such thatrdiscretc: competencies 
canrfoe empirically validated, Mijr.<[B]r.E movement in New York and else- 
whore will have lived up to itsMcamseaniirwill have overcome the traditional 
criiimisms of teacher training T^ogtsms^-^wever, I am bothered by the fact 
that: the target date is 199C-'i.^'^OThg »namediate questions concerning the 
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period from 1975 until 1990. As an attorney, I must ask whether a state can 
impose credentialling requirements on a person who wants to teach in the 
public schools when, by its own admission, these credentialling requirements 
are presently unvalidated. Furthermore, many writers assert that even by 
1990. it will be impossible to obtain satisfactory, hard, empirical validation 
of the discrete competencies. If that is true, there are fundamental questions 
as to whether CBTE, now or in the future, will be better able to withstand 
legal challenge than a traditional teacher-training approach. ' 

Since traditional teacher training programs which continue to prevail 
in many states, as well as many newly-implemented CBTE programs, may 
shortly be, subject to direct legal challenge, let us now turn our attention to a 
brief description of current legal developments which are affecting creden- 
tialling and licensing fields. Any discussion of legal challenges in the area of 
licensing and credentialling must, of course, begin with a reference to Title 
VII of the Civil Rights Act of 1964. 1 wUl not attempt at the present time to 
undertake a detailed analysis of the statutory provisions or specific cases 
decided under those provisions, with which many of you are probably famil- 
iar. For present purposes, let me just state that Title VII outlaws employment 
discrimination and, among other things, the statute and the ^regulations 
promulgated thereunder by the Equal Employment Opportunity Commission 
("EEOC"), specify that an employer may not use any type of entry examina- 
tion, whether it is a written pen and pencil test or any other type of selec- 
tion system, unless that system is shown to be "job-related." 

This requirement for a clear showing of "job-relatedness" has led to a 
dramatic increase in litigation in a wide variety ofliicensing areas, including 
the education field. I have personally been involvecDwith the Chance^ case in 
New York Qty where the federal district court: invalidated the licensing 
examination system for principals and other supervisors. There have also been 
a number of cases which have successfully challenged the use of the National 
Teachers Examination as a job selection device.^ In addition, the dozens of 



^Omnce v. Board of Examiners 330 F. Supp. 203 {S.D.N.Y., 1971), affd 458 F. 
2d 1167 {2ilCir., 1972). 

^See, e.g. Baker v. Columbus Municipal School District 329 F. Supp. 706 (N.D. 
Miss., 1971), affd 462 1112 {5th Cir., 1972), United States v. Nansemond County 
School Board 492 F. 2d 919 {4th Cir., 1974), CAmfcd States v: State of North Carolina 
Civil No. 4476 (E.D. N. Car., 1975). 
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litigations brought under Title VII against other public agencies have estab- 
lished precedents which are of direct relevance to any analysis of future chal- 
lenges to tea^^r ere denti ailing or licensing systems . 

Two recent decisions of the United States Supreme Court have upheld 
and enhanced the impact of the EEOC regulations in this area."* The court 
in these cas^s (which specifically involved private industry, but which, since 
the 1972 axT^endment to Title VII, apply also to school systems and other 
state agencies) upheld the applicability of the specific guidelines that were 
issued by th'e EEOC This was somewhat extraordinary, because these stand- 
ards were far more detailed and exacting than the general anti-discrimination 
pronouncenients enacted by the Congress m the Title VII Statute and because 
these guidelir^es were not full federal regulations which had been submitted 
for public scrutiny and comment as required by the Administrative Procedure 
Act. But under the Supreme Court decisions, the EEOC guidelines have 
virtually been given the effect of law. 

It is important for these reasons for us to briefly consider the precise 
content ofrthe EEOC guidelines. Basically, the guidelines state that no written 
.test or any other employment selection device may be used unless it is 
'^validated." Validation under the EEOC guidelines is described under two 
main headiJiB^: "predictive validation" and **content validation." Predictive 
^validation is the higher standard, which is nomially require±of all employees. 
Stated simfly. it means tiiat if an employemutilizes, forasxample, a written 
test as a basi^ for hiring, heimust demonstrate that such adest is a valid indi- 
cator of actual competence on the job- He must show that those who pass 
the test and ^hose who receive higher grades cm the .test perform better on the 
job than:rth^^6 who fail the test or obtain lower grades. In other Avords, he 
must empirically demonstrate that this lest validly predicts competence on 
the job. To Establish such predictive valSiation obviously lis a very compli- 
jcated, expeJi^lve, and time-consuming procsss. 

Alth(^Sh predictive validation is theT}rerened standard and is required 
generally iu-^^es involving private companies, in many of the public sector 
• cases which: have arisen, the courts have invoted a clause in the EEOC guide- 



GriggS V. Buke Power Company 401 U-S. 424 (1971); Albermarle Paper Co. v. 
Moody 95 S. d. 2362 (1975). 
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lines which permits the use of "content validation" where predictive valida- 
tion is presently "not feasible." Content validation aims at the same general 
result as predictive validation, i.e., assurance that a test is an accurate measure 
of competence on the job. But, instead of requiring empirical predictive cor- 
relations, content validation requires the employer to show that the content 
of his test, on its face, is rationally related to the specific descriptions of the 
job which the employer has. promulgated. For example, if a test is given for a 
position such as speech teaching, wherein most of the person's performance 
will depend on his verbal facility, a test which has one question involving 
verbal facility and 99 questions asking for familiarity with famous authors of 
English literature would not satisfy content validation requirements because 
the person is being tested for something that is not related to the actual de- 
mands of the job. 

As 1 mentaonted earlier, in a number of cases courts have applied the 
EEOC guidelinsfis in striking down certain licensing standards, including those 
previously applicable to all principals and supervisors in the City of New 
York. Technically, thoi^Oimce case and many ofithEiOther early litigations 
against public empdoyers— t&ose which are most reiexant to us— <lid not arise 
under Title Vlllbecause itwas not until 1972 thati35tle VII was extended to 
cover state and loxsal garvemmental agencies. The laavrijSDnnerly applied only to 
private companies^IntEsiestingly, however, in the 972 cases, although the 
challenge would initiaaiy be brought on generabsqual protection grounds 
under the Fourtcienthi Amendment, the plaintifEsrwould then "indirectly" 
refer to the EEOC guiiielines. They would argue:ithat, although technically 
the guidelines are not ibinding in the particular esse, the EEOC, the expert 
agency in the ecnployment discrimination area*, has devised methods for 
assessing discriminatioB: by employers, and certainiv., public employers cannot 
be held to a lower stimdard of non-discriminatniy performance under the 
federal constitution. Thus, the EEOC guidelines jcame to be "indirectly ap- 
plied" in public sismpioyer cases and this undonbtemly provided a strong 
motivation for Congress to formally amend Title VTI to specifically include 
public employersaindenhfi Act. 

It is also important to note that technically teoth Title VII and the 
EEOC guidelines specifically apply only to certain defined minority groups, 
such as Blacks, Hispanics and women, who have beea victims of discrimina- 
tion, hi order for plaintiffs to prevail in a Title VII case they must first show 
that the examination or licensing system has a "discriminatory impact" on 
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the minority group which constitutes the plaintiff class. That is, they must 
prove that Blacks, for example, are failing a licensing examination, or are be- 
ing denied credentials, in a larger proportion than ave Whites who are apply- 
ing for the same certification. In many of the traditional written pencil and 
paper examinations, such as the New York City licensing examinations, such 
discriminatory impact has not been difficult to establish because the relevant 
statistics have indicated that minority groups do, in fact, fail in dispropor- 
tionate numbers. Once this showing of "discriminatory impact" has been 
made, the burden of proof shifts to the defendant, the public aguii^ry, which 
is then required to show that even thou^i this exam has a illscnminatofy 
impact, the court should permit its continuation because the test is job 
Tiilated and there is no alternative examination available which would not 
have a discriminatory impact on a minority group. Obviously, establishing 
such job relatedness imposes a heavy burden on an employer, especially when 
the rigorous predictive and content validation standardsiof the EEOCiare the 
^applicable guidelines. 

Although plaintiffs have tended to prevail in many challenges to written 
-ilicensing examinations where it could clearly be shown that minority groups 
were failing in disproportionate numbers, for our present: purposes at this 
conference, we must consider whether a suit against state-wide credentialling 
systems which rely on the program approval or CBTE approach would also 
ihave a reasonable chance of succeeding, especially if, as in many cases, few 
minority candidates apply for credentialling or discriminatory impact cannot 
easily be shown. (In contrast with a written licensing examination where one 
can easily compQe statistics on the number of minority applicants who sat for 
the test and the number who received passing grades, the typical approved 
program credentialling system raises substantial problems such as the defini- 
tion of the appropriate pool of applicants. Does it consist of those who ini- 
tially applied to the teacher-training institute as freshmen and/or those who 
reached a certain stage in the professional training process? Is a.: state re- 
sponsible for admission and testing processes at colleges in its state or at 
colleges any where in the country whose programs are reciprocally recog- 
inized?)^ 



Some available college entrance and college graduation statistics may support an 
attempt to establish a showing of discriminatory impact in credentialling. See,^.^.. White 
and Francis, "Title VII and the Masters of Reality" Geo. Wa.'^h. L. Rev. (forthcoming). 
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If discriminatory impact cannot be established, Title VII, which is ex- 
plicitly directed toward problems of employment discrimination against 
minority groups, would not directly ar»T ' However, the fact that for the 
past five or six years, the courts h c , elves in detailed analysis 

of reasonable standards for assessiji, ate inesvs and have become edu- 

cated in psychometric approaches to asst an^: :ob < ' petesice is highly signi- 
ficant. Given this background, one cannot assume that the courts would 
refuse to consider a strong attack against an irrational licensing system merely 
because the plaintiff is not a member of a minority group or has not statisti- 
cally established discriminatory impact. Ten or fifteen years ago, a case 
attacking the irrationality of licensing systems probably would have been 
dismissed out of hand because the accepted legal doctrines of due-process and 
equal protection would not permit a court to closely examine the substantive 
licensing standards that state officials, who are presumed to be experts in the 
field, had established. But the EEOC has now given explicit tools which 
enable them to intelligently delve into these questions and to require state 
officials to defend the substance of their programs. 

An additional legal development of recent years which lends further 
credence to the possibility of a successful attack on an irrational state creden- 
tialling system is the trend toward "re-vitalization" of the classical "rational 
relationship'* standard for invoking the equal protection clause of the Four- 
teenth Amendment to the federal Constitution. Traditionally, the Supreme 
Court, especially the Warren Court, made a distinction in its equal protection 
decisions between those types of claims which they ^ould examine ^th 
"strict scrutiny'* (generally cases involving certain suspect categories of 
victims such as racial minority groups or certain "fundamental interests*' 
such as voting rights) and all other cases which the court would review in 
perfunctory fashion. In a strict scrutiny case, the state would have to show 
that the challenged law or practice' was absolutely necessary, that there was 
no other way to accomplish the result. Since there ahnost always is such a 
possible alternative, almost every case which received "strict scrutiny*' 
resulted in victory for the plaintiffs. By way of contrast, in cases not receiv- 
ing "strict scrutiny,'* the courts would invalidate a state statute or state 
action only if there was no possible rational relationship shown between the 
statute or action and any conceivable legitimate goal or purpose. If the case 
was.analyzed under this "rational relationship'* rubric, the plaintiffs generally 
would lose because almost any state action will have some plausible rational 
relationship to the apparent purpose of the statute at issue or to whatever 
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purpose its defenders could conceive of at the time the case was argued. In 
these cases, the courts would not consider other methods of accomplishing 
the purpose which might be less detrimental to the interests of the plaintiffs 
or other affected individuals. 

In recent years, this strict dichotomy between strict scrutiny and ra- 
tional relationship analysis has begun to break down. In the Chance case, for 
example, as well as in the Armstead^ case involving use of Graduate Record 
Examinations, as a qualification for teacher employment, the courts refused 
to apply the^strict scrutiny standard (probably because they were bothered 
by the factdtSiat the discrimination shown was not intentional). However, in 
applying thetaltemative "rational relationship" text, these courts undertook 
a substantive: rather than a perfunctory analysis and held tliat the examina- 
tion requicBinents were not substantially related to the purpose for which 
they exist. Jn other words, these courts "re-vitalized" the traditional rational 
relationshijnapproach and gave it some bite. 

Thesertwo licensing decisions are not isolated phenomena. Interesting- 
ly, the Supneme Court itself seems to be mo\ing in the direction of breaking 
down the i|g^orous dichotomy in its equal protection analysis and appears to 
be creating::anniddle ground which permits substantive analysis of situations 
which do not:invoIve the classical racial discrimination or other fundamental 
interest categories. Without exploring the issue in any great detail, I would 
merely point out that the Supreme Court's, major decisions in this area 
involve sex :mscriniination cases;'' one gets the impression that the court is 
not eager to> declare sex discrimination one of its "strict scrutiny" areas 
because, then as I noted above, almost any case that comes before the courts 
will automatically result in a victory for the plaintiffs, but, on the other hand 
the court realizes that the rising tide of sex discrimination problems cannot 
lightly be set aside. This "middle ground" of a revitalized rational relationship 
analysis which the Supreme Court is creating in the sex discrimination cases 
dovetails with other trends in the licensing cases and indicates a strong 



Armstead v. StarkvUle Municipal Separate School District 325 F. Supp. 560 
(W.D. Miss., 1971), afrd 461 F. 2d 276 (5th Cir., 1972). 

'^See, fcg: Reed v. Reed 404 U.S. 71 (1911), Frontiero v. Richardson 411 U.S. 
677 (1973), Weinberger V. Wiesenfeld 420 U.S. 636 (1975). 
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'possibility that a valid challenge to an irrational credentialling system will be 
upheld by the courts, even if no racial discrimination is shown. 

A good illustration of these changing judicial trends is provided by Prof, 
Gerald Gunther in an article wliich appeared in the Harvard Lav; Review 
several years ago.^ Gunther referred to the case of Williamson v. Lee Optical 
Co.^ a licensing-type case from about twenty years ago where the Supreme 
Court invoked the traditional rational relationship test and refused to sub- 
stantively examine the state restrictions on the opticians' profession which 
were at issue in that case. Mr. Gunther indicated under the emerging new 
equal protection directions, a statute of this type, and the legislature's stated 
or probable reasons for passing it, would be more closely examined by the 
court and it might not so easily pass muster as it did twenty years ago. 

In addition to a Title VII or an equal protection suit based on the re- 
vitalized rational relationship test, a number of other legal bases for potential 
challenges to credentialling systems should be mentioned. The first would 
be a "substantive" due process claim. As the lawyers in the room are aware, 
substantive due process is a doctrine that had been considered dead and 
buried for the past few decades, since the Roosevelt Supreme Court reversed 
its predecessors' attempts to scuttle the New Deal by reference to the 
businessman's "substantiye due process" right not to suffer government inter- 
ference with his operations. However, a number of recent privacy cases, 
including Row v. Wade}^ the abortion decision, have begun to resuscitate 
the substantive due process concept. Interestingly, these privacy decisions 
have cited early education cases which upheld the individual's right to pursue 
a teaching career, without unreasonable governmental interference^^ as 
precedent for the continued viability of substantive due process in a non- 
business situation. Also relevant in this regard are the alien discrimination 



"Foreword: In Search of Evolving Doctrine on a Changing Court: A Model for 
a Newer Equal Protection" 86 Harv. L. Rev. 1 (1972). 

^348 U.S. 483 (1955). 

^^410 U.S. 113 (1973). 

^^Such as Meyer v. Nebraska 262 U.S. 390 (1923). (Statute prohibiting teaching 
of modem languages invalidated.) 
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cases such as in re Griffiths, a case which involved an alien lawyer who was 
barred from obtaining a license to practice his profession by Connecticut law. 
The Supreme Court held there that the state's restrictions were discrimina- 
tory and unconstitutional; in the course of its opinion the court discussed in 
some detail the purposes and substance of the challenged licensing restric- 
tions and rejected the state's explanations and justifications for them. In sum, 
this growing trend toward a re-vitalization of the substantive due process 
concept may lead a court to seriously consider a future claim of a plaintiff 
who alleges that he has been denied his substantive right to pursue a teaching 
career by an irrational state credentialling system. 

A further, and highly likely, basis for legal challenges to a CBTE system 
is the doctrine of illegal delegation of legislative authority to administrative 
officials. Delegation was in the background of the recent opinion of the Texas 
Attorney General which^ as most of you are aware, has led to a profound 
restructuring of the CBTE program in that state. Although that opinion 
was specifically based on an analysis of certain Texas statutes which the 
Attorney General ruled did not permit the State Commissioner to mandate 
that all teacher education programs in the state be competency-based, the 
framing of the issues in that situation leads to the broader question of 
whether a fundamental policy shift such as CBTE may be mandated by an 
administrative agency in the absence of detailed legislative authorization. 

A fifth area of possible legal challenge might arise under the First 
Amendment to the federal Constitution. Conceivably, a school that, for what- 
ever reason, does not want to accept a mandatory CBTE directive from a 
state education department might claim that mandatory CBTE inhibits the 
ability of the school and its individual faculty members to teach in the man- 
ner that they believe best suits their needs, their values and their purposes. 

The final type of possible challenge which I foresee is a consumer 
protection suit, which might be brought by two separate categories of **fcon- 
sumers": college students as consumers and parents of public school children 
as consumers. Paul Olson has already mentioned suits which have been filed 



'413U.S.717 (1973). 

'opinion H'i97» January 4. 1974. 
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by college students who claim they have been defrauded in enrolling for 
courses which do not teach what they promise to teach and which do not 
prepare students to be competent professionals in their field. Parents of 
public school children may have standing to challenge the credentialling sys- 
tem of the state if teachers who have been officially certified as competent 
to teach, in fact, prove incapable of meeting their children's education needs. 

In sum, then, those administrators who are responsible for the adminis* 
tration of state credentialling systems should be aware of these six potential 
types of legal challenges and, to the extent possible, should attempt to cor- 
rect present 5jhortcomings and thereby ward off such attacks. Of course, in 
assessing the likelihood that suits brought under any of the above six legal 
theories would succeed in invalidating state credentialling systems, we should 
consider the fact that the CBTE movement is, in general, an attempt to im- 
prove the deficiencies of traditional credentialling systems. One would expect 
that courts would be favorably impressed by a state's honest attempts to 
undertake reform. On the other hand, as I discussed earlier, a significant point 
about CBTE is that in criticizing traditional teacher training programs, CBTE 
raises fundamental questions which may boomerang and lead courts to hold 
CBTE programs to the demanding standards which they themselves have now 
established. 

Since I have undoubtedly raised troublesome apprehensions in your 
mind concerning possible legal challenges you may face, in all fairness, I 
should utilize the remaining time which is available to offer a few sugges- 
tions which might aid you Li defending such lawsuits. Let us then consider 
briefly some of the elements which would appear to be essential to the 
design of a valid licensing system. I will assume that the standard with which 
we should be concerned in this endeavor is the content validation standard. 
Predictive validation, that is, empirical demonstration that credentialling or 
licensing requirements are directly correlated to specific on-the-job per- 
formance needs, is a standard wliidi public employers do not y^t seem 
capable of achieving, certainly not in the teacher education area. The courts 
have indicated that, for the moment, until predictive validation is "feasible," 
they will generally accept content validation in licensing cases. Our immediate 
question then is, until such time, if ever, that we obtain accurate empirical 
assessment devices, what interim validation methods will be acceptable to 
the courts? 

In describing the elements of a valid licensing system, the courts in 
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Chance^ Nansemond, and other such cases, have consistently emphasized the 
need for a thorough, exhaustive job description. This is really the key to 
acceptable content validation. If you do not know what the job you're test- 
ing for really consists of, how can you purport to construct a test, or a cre- 
dentialling requirement, that will certify qualification to perform that job? 
The judges in the above cases had little difficulty, once the issue was clarified 
in this manner, in striking down licensing systems when the defendants^could 
not show that a serious analysis of the job's duties had recently been under- 
taken. In the Glance case, for example, the Board of Examiners were unable 
to show any organized job analysis process, and it appeared that their job 
descriptions for principalship positions were subjectively established by 
central administrators who would then consult, in ad hoc fashion, a number 
of outside experts whose qualifications or relationship to the system were 
unclear and whose views in any event were not solicited in any systematic 
manner. Three years later, when the same New York City Board of Examiners 
were again put on the stand to defend an attack against their teacher licensing 
system,^^ they were more sophisticated. This time, they came in with a huge 
stack of documents purporting to reflect extenave empirical investigations 
of what teachers actually do. One might say that in Rubinos, the defendants 
at least met the minimal responsibility of establishing their good faith and 
seriousness of purpose. 

But I think the courts are going to require a lot more than such minimal 
good faith. Based on the United States Supreme Court's opinions in the 
Griggs and Albermarle cases, cited above, as well as my personal experience 
as the attorney for the amicus curiae community school boards in the 
Chance^ ^ litigation, I would emphasize the following key components of a 



Rubinos v. Board of Examiners, Qv. No. 74/2240 (S.D.N.Y. filed May 24, 
1974). A decision is still pending in this case. 

As discussed above, the Chance case involved a civil rights attack on. the exami- 
nation system used for licensing all principals and supervisors in the New York City 
school system. The federal district court declared the examination system unconstitu- 
tional five years ago for the reasons discussed above. We have spent the last five years in 
New York City attempting to draw up new standards that would be acceptable to the 
court. Thus, Chance provides an ideal case study for our purposes because to my knowl- 
edge it is the only case in the educational licensing area where a new system had to be 
created under direct court supervision. Some of the points to be discussed in the pages 
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vaUd job analysis. First, the specific job areas should be clearly defined, but 
at the same time, the specificity should not be atomistic. For example, in the 
Chance situation, the consultant's report identified approximately 19 major 
duty areas and weU over 100 specific tasks for the job of high school princi- 
pal and recommended these elements as basis for the job description. The 
large number of task areas in this report (like the hundreds of discrete teach- 
ing competencies which have been emphasized in several CBTE competency 
catalogues) clearly appear to be unmanageable, while the suggested major 
duty areas seemed too vaguely defined to be useful. 

Secondly, a representative cross section of persons who have an interest 
in the selection or evaluation process must have input into the job analysis. 
This means, for example, that the job cannot be defmed exclusively from the 
perspective of present job holders because, especiaUy with current pressures 
for upgrading and updating job responsibilities, newly-hired personnel may be 
expected to perform different functions or to emphasize different approaches 
to the job. In other words, present incumbents may not necessarily be per- 
forming correctly, or in accordance with the perspectives that contemporary 
poUcy makers wish to stress. Thus, the job description must contain a sense 
of direction. It cannot be a status quo report on how the job is presently 
being performed. Furthermore, in order to satisfy the courts, especiaHy in a 
discrimination situation, administrators must be sure to include input from 
minority appUcants or women who have been prevented from obtaining 
this position in the past. 

In this regard it would also seem that an essential element of the job 
description is tiie perceptions of tixose who have a role in poUcy-making and 
defining tiie relevant accountabihty standards. Interviewing only the tradi- 
tional "employer" may not satisfy tiiis criterion. For example, the 32 com- 
munity school boards in New York Qty have recently been vested with 
employment and job description responsibiHties that formerly were exclu- 
sively lodged with tiie Board of Examiners and tiie central autiiorities, and 
tiieir views tiierefore are important. CBTE advocates have recognized tiie 



which foUow emerge from critidsms which the plaintiffs in Chance have lodged against 
a job analysis prepared for the Board of Education by a professional consulting firm. 
(The board itself apparently has concurred in some of these views, since it recently 
indicated to the court that it may not adopt the evaluators' recommendations.) 
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need for increased participation of community representatives in the con- 
sortia that define competencies, and I think such a reflection of local needs 
is essential in any job description that purports to relate to actual local job 
requirements in a large city or a state. Otherwise significant urban-rural or 
cultural differericeswill not be reflected in the job description ► 

A third factor, discussed by the Supreme Court in its Albermarle 
decision, is the importance, in many cases, of having independent outside 
consultants undertake the job analysis. If in-house administrators who, so to 
speak, have an investment in the outcome monopolize the process, the courts 
may be suspicious. 

Preparation of an adequate job description is the initial stage of the 
^ licensing process. The next step is the construction of the test or statement of 
standards, based on the specific job description enformation. Tlie major con- 
cern at this stage is to be sure that there is a sigmficant conelation between 
the test or the licensing standard and the detailed job description— that is 
what content validation is all about. This suggestion, of course, seems rather 
elementary, but in the Albermarle case the Supreme Court noted that 
although acceptable evidence was put forward validating three "job lines" 
at issue in the case, the defendants sought to utilize that limited information 
as a justification for implementing tests for eight job lines. The defendant 
company claimed that these job lines were very simflar and overlapped, but 
the court held that because there was no acceptable analysis of the job skills 
in all eight lines, there was no basis for concluding that they were similar. On 
the basis of the decision in Albermarle, one might safely conclude that a 
37]/i per cent validation correlation is unacceptable. Whether the degree of 
correlation must therefore be 50 per cent, 75 per cent, or 99 per cent has not 
been made clear, but those who construct exams and standards have been put 
on notice by the court of the importance of this issue. 

The next consideration in constructing a valid licensing system is the 
question of proportions. A job description may identify 20 basic job ele- 
ments, but that does not mean that each element is necessarily as important 
as every other and that each should therefore receive an equal weighting in 
the overall requirements. Obviously, some aspects of the job are more impor- 
tant than others, and these proportions and priorities must be reflected in the 
examination or selection standards which are developed. In this connection, 
I would point out that it will be extremely difficult to validate absolute cut- 
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off requirements which preclude those who do poorly in one part of an exam 
from eligibility to undertake the rest of the test. Qearly, the concept of pro- 
portionality imposes heavy burdens on those who would maintain that 
certain skills, measured in specific quantifiable degrees, are absolutely essen- 
tial to successful job performance. 

Finally, once specific selection criteria are developed, the test or cre- 
dentialling standards must be reasonably anc: con^stantlr/ -applied. Ic the 
Ai^emarle case, the cQjs^^^\y employment se^rHiti^^^^i^if^mi was invalizcated 
hrv the U5r Supreme Cm-i'i because ofaiaijafcoi afective application 

of the relevant :TOb st»i?fii«2«c,T7Iie supervisory rating stacsssards were ajpplied 
iaconsistently, with li^^imtiij£=sndards not being utilizeir i^i the same propor- 
tions by all supervisors3a:rOfi5-> le board. 

I appreciaterthe c .siiic5n you have given to my remarks this afternoon, 
especially since I have : veil past my allotted time. I suspect that the im- 
pression I have left v^ y^m is that the courts are imposing extremely de- 
manding validation stsaniaitas. Leaving aside Ihe technical jargon, however 
I think it is fair to say tiiar. all that the courts really aassrasking for is reason- 
able adherence to basic ^mdards of fairness and ratiniaality; they are:really 
only following the criterisnthat practitioners of CBTESiave imposed oa them- 
selves. In this regard, on- final point I woidd stresses the importance of 
providing^ flexible options, some alternative licenang mechanisms which 
credentialling candidates might pursue. If it appears that the licensing system 
is not overly rigid, that the CBTE experiment is-^not being imposed in a 
monopolistic manner and that candidates are ^ven every reasonable chance 
to demonstrate their qualifications, the impression of basic fairness and 
rationality and the emtire Jitigation posture will undoubtedly be enhanced. 

Now, if time permits, I would be happy to answer any questions. 

Question: In view of what you've said about different community input, are 
you suggesting that teachers be trained to teach in specific areas only- 
because that's a logical extension of what you're saying? 

Answer: What do you mean by "specific areas?" I certainly wouldn't advo- 
cate that teachers be trained only for.jobs in specific geographic areas. But if 
what you mean is training to specialize in certain types of problems and 
in dealing with certain types of people, I would probably favor such an 
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approval. Let me try toacpproa4mTi5isi>qu£53rion another *Kay. It is my under- 
standing that the logic of llhe CfftlTE^'^issm requires colics to train people 
for specific jobs. The raadoraak i\^r ?i?flEE.!isits emphaas onudirect correlation 
between skills actually needttfi : a d^isssmsom, md what stooieiits learn in the 
teacher training institution';, lit^^eemstnic lhait this means that if there is a 
substantial difference in the f£j*- ^hte^rt^A'OT^'isuent in an urban ghetto or in a 
rural farm community, th^ Gbv7' ^^f^CTa^ ^^nust account for those differ- 
ences or it will not be pr^^Mliiiifi ici^acscfii^.rao will be competent for the 
specific job. Have I fairly sXzw^t^r^ii CQITEitems to do? 

Question: It depends on one's de frriixiatii. 

Question: Could you give a brief i?s:^iiE\'i?rifisv^ of what the likely criteria are, 
or the area of the emerging niid^ '^r^mrr d relationsMp?'^ 

Answer: I assume you are refef'^EP-ii^/t iixe "middle groundT' between the 
Supre^ -e Court's traditional:dichiiot^'i?' 're^ftw«gi cases involving suspect classi- 
fications or fundamental intere x^jdi. tn^Jiiwe "strict scrutiny" and other 
equal protection cases, which x -'^xsmar a::peTfunctory analysis &om the 
court so long as there was somie ^^^^^^^ r^- :2iationship"^ between tihe chal- 
lenged practice and a legitimateiss^r^ -y^tipo^^. 

An example of strict scrui r^s^ijfSia, which is traditionally applied 
to voting rights cases, is provided - ^lixv^aiSktax. situation. Let us assume that 
you have a state law which reqv -^snnsdltax. There are obviously many 
valid, plausible justifications for dltisscss: they are a method for raising 
money, and for assuring that those wfaocrrane out to vote have some interest 
in and hopefully some knowledas ofrthe assue at stake. It is a system that has 
been in effect for generations, an^tissEfccEa, it would seem, on its face, to be 
a "rational" system. But because vcinEj^iOTits have been defined as being an 
area of "fundamental interest," the.:Sro5EiiK Court^^ invalidated a poll tax 
statute which interfered with tiicae: Tights even though the law might be 
"rationally related" to legislativeistaas qnmposes such as raising taxes or 
motivating voter interest. Applyii^snniinscnitiny, the poll tax was deemed 
not to be a necessary state actiDm.smius* as the court implied, reasonable 
alternatives which affected the piiiinmife' inisrests less ifetrimentally, were 
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available to :accompliah ttJie stace's purposes. Sf that case had been analyzed 
under the raiimmal reiiatiojnship criterion, however, the poll tax undioubtedly 
would have been upfcteld because obviously tht- tax did have a rational rela- 
tionstiip to the legitijn2i:e state aims of raisicr taxes, motivating voters, etc. 

Now under the middle ground or "re-vitalized rational relationship" 
approach I've been describing, the state will not necessarily have to prove that 
there is no alternative way of achieving a valid state prrpose as in the strict 
scrutiny situation. Ler me use the Lee Opticnl case as3n example to try to 
bring out this distinction. As I recollect, the issue in that case was that 
opticians were barred from making glasses wnthout a iprescription from an 
optometrist or a phg^sician. In other words, they were not permitted to 
examine peoplfi/s eyes or even to prepare a prescription from studying an old 
or broken pair of giiasses, unless they were licensed as optometrists or op- 
thomologists. The Supreme Court's 1955 decision indiicated that there is a 
"rational relationship)" between the valid state: aim of protecting eyes and 
encouraging eye exaininations and the particular statute which had the effect 
of requiring a child who broke his glasses or even his frames to undergo an 
optometrist examination before the glasses or frames could be replaced. The 
court speculated as to a number of purposes thie legislature might have had 
in mind in passing the statute (except, however, for the most likely real 
reason— the strength of the optometrist's lobby) and held that even though 
the laws here may on balance be "needless" or 'Svasteful,'' if the legislature 
could be deemed to have one or more plausible intentions, its statutory 
scheme would be held acceptable under the rational relationship rubric. Now, 
under the new middle ground standard that I have described, the court in a 
1975 Lee Optical case would look more closely ait the real purpose that the 
state legislature had in mind and whether the statute at issue fairly and sub- 
stantially accomplished that purpose. Under such an approach, the Lee Opti- 
cal case might well be decided the other way, if the court were to probe and 
find an improper state purpose (aiding the optometmsts' lobby) or an irra- 
tional implementation mechanism which heavily burdens, both the opticians 
and tthe public to accomplish a result which might ea^ be better accom- 
plished by other means such as requiring eye examinations for school entry, 
renewal of drivers' licenses, etc. 

Question: Why do the courts seem to be preoccupied with teacher licensing 
systems? 

Answer: I hope I have not given a misimpression. Many other state licensing 
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systenns are eminent^' ^eing challenged, teaching is 3 means ajni relume 
target. Nimnerroiiis cases Jiave been brou^t agaimst eiiL for policcBSHssDrSEs- 
mcn amd cHttemaviy service wxorkers, including t2ie nKEi rs of the'Newlrrrik 
City Boara:a^' Ex ain ineis thennselves. For some reascic, . ue have ■y'Toe'Tji a 
spate of cs5esr;ui TradoiiS stMES attacking licerasing racqt rements ioie simider- 
takers and fumeralaaiiecrors. Teacher cases gain; a cemin .amount L'finwn^'iidgy 
because the tsacbsr: tanks are so ncunerous audi because dhere is 23siatp3abHic 
concern in this sxsui^.. The il^al stamdards that I ha\^' been discuam^i^ply 
across the board in 2: gisarnmnnber of areais. Hie caseis tlhat have inaidtinated 
undertakers' eacamssaaon. xaaiice exams, tor \Khatevei, g)rovide legal ipRrece- 
dents, pro and con.., Hor wiiiiiii goes on in Ihe teacher licensing azea dm vice 
versa. 

Question: How dccTthe VH requirements lapply to state czgadenti filing 
requirements? 

Answer: The EEOC regulatioEns speciifically appay to ^tabiliity tesHswhicirnare 
designed to measuie eligiliiility for hire, transfer, pronmtion, training, referral 
or retention. . . The term ''test'' indudes all formal, scored, quantified or 
standardized techniques of assessing job suitability including . . . spedfic 
qualifying or disqualifying personal history or background requirements, 
specific educational or work Mstory requirements,"^ etc What thisappean 
to mean is that any standard or criterion that is used to restrict employment 
opportunity, including a college or professional degree requirement, would be 
subject to the Title VH standards* NtDW, with a private employer, restriction 
on employment nBsaans.ideclinflng ta iBSs:s^t someone who applies fer a speci- 
fic: job. One inight3say that creaientiaBTimgis a step removed from thus situation 
because accreditatiison is not nynonymoms with being hired for a: particular 
jok^But, I think:ti3at credentialling practices^at least if they are sihown to be 
disdriminatory, wouild be ccsvered by the lEEOC guidelines bcacause they 
restnict entry; if yom do not qualify for the liosnse, you will be denied access 
totihe job. 

Question: Was the National Teachers Examinstion itself struck down in the 
cases you mentiomed, or was it the. way the test was used thafl was struck 
down? 
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Answei ihe court.. inv;aidaitud the use otf the N'E.as ^iy -^Jiclusive ibasis for 
rejection o : applicsats ibr tsiucher jobs. Specificmiy,:^^. vcairts hdithat a 
cut-off -^-TH score was r-ot zk valid method for enmixEErJ^; applicants since 
there «:«;v no shov^ mg: tb;i-i Mestions asked on the NT^ nai any dixed nsla- 
tionshi: :io actual f;:eqmirejrRrnt5 of the job. Intersstim^t v. j\ many of these 
cases, lOTTesisntatir-fs cof triiT Educatiomad Testing 5ervii-;.. vhich created ihe 
NTE, teriified thz the er^Erm was being nnisused and r .id never beeni in- 
tended I provid*i:xn exciizsm e basis for teacher hiring de 'ns. 

Question:: I see omly dirss bjisikraMematives coming oui- i the Chancex^SQi 
(1) a waaeieii down::n!siEinialiSt2[te standand for licensingi;^ try to encconpass 
the state: as a whiole: ;I2) n:tu:; .jirowth of a mumber of liceising titles that are 
just absoiiitely mniiati!m>^2!ing:.and (3) wiping out of stHifc licensing systems. 

Answer: I ±ink ymi. tii?^^ qnm correct in your perceptiinis. As you know, I 
have been personalil iniianEito favor the first or theirlnni of the possi&ili- 
ties youmentioned.atiieasa on a temporary' basis umtil vacidated new licensing 
systems axe cxeated- so I am not shojcked at the impksniions^^jf your state- 
ment. I Sim sure we iiifer oixi that- In regard to your tserand.possibility o£ a 
proliferatEan of job uMes, 1 trakht poiat out that one ini333:estiog result of tme 
job analysis for New '^ork Qn? suroeniaffiDrs was the consiitrants' recommencna- 
tDons that many of the existing jmb titHesbe combined. Hnwever, that may be 
a unique situation becamse !New Yorkirhad something likea hundred different 
joh titles forrsupeirviscirs, wMc£L„of cDurse, is absurd sinzx, obviously, many 
of them must have.overla^yped^If ycmr present system has two or three job 
titles, it is possible rtiaat a jobnanai^sis will resailt in breaking these down into 
a dozen or more. 

Quesimn: Your comment amixi urban-rura^i is a direct indication that now 
there is mo disnncticsn made umder ttbs: present systenn, iind if you go to a 
coEirt test of i3C£:'-3saie licensiing sysimiii, which I thinkzmight be interesting, 
that may stop sonr " Bresentmovementtsthat are pretty niappropriate. 

Answer: Maybe- kthink one other pcnnt I should itnention about the Chamce 
case is that tfo2 risaurt there has alnsidy begum Tirrmove in the directioni of 
ennphasizing Icanalj orientation in licairsing stani\i^^>-a.._ The new system nego- 
tiated by the ::pasntiEs aMd orpproved b>.^*:the ct}m: '.mi .^Uy case establishes city- 
wide entT-ance.es^inaitisiift standar3H'^.Tvhichi ii^^ by the 
local caoimuamrV boaiiszLrThen*. afiter cone ^sar of om^ experience, the 
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cannidate will undergo a perforirance evaluaticci for a Si^'i-ond sun^e licensure^. 
Tfe second stage is obNiously mere community- jrientec 

Qaiestion: There are some people in this room tliat dou^ tiioink directly in 
tkatJine and don't accept minintai standards as a basis. 

Answer: Given the pretsent state of research and given aL tne inTruf.quacies one 
can point to in apgilying the EEOC standards to most a: nne pissent licensing 
systems, my natural re^ii^tion is xo say that until th.L- stane can.cJKne up with; a 
solicn licensing standare that meets validation criteria, i: has nro iicgal right to 
impose employment isstrictionis on people, Un'i/ ycu cm .:r:rme aip wMi 
imeaningful, validated requirements, you should ^nly mt sdiimsi^d to apj^^;/ 
minimal. standardls because a stafi ahould not atb: npt to <ri£ciiiis that certain 
people are not qualifncd for the profession if it aioes nou rcailiy know wthat 
qualification in.Dhe profession means. 

To the extent tiatwe presently lack knowledge to acnrstruct valid state- 
wide standards, or ai least rigoiious standards, rpersonalfyvtend to emphasize 
onsthe-job evaluation .aiSM^eing the most reasonable avaiiiibieassessment tech- 
nioue. On-tte-job evirininnon, of course, can only* be dr^^ne in a meaningful 
waa^ on :a local ilevel, according to local needs an;:i local, aajssessraents. Now I 
reainze tfae calibre or evaluiation umdertaken by loca^ schoniniiistrEcts in^enemiil 
has been even more bacScwards than state-wide Ittcensn ^ ^ractices,, But nn: 
temms of short -nun feasibiMty, inatQ we reach tbe^^ge ofanccurate predictte 
valndatian fox broader standards- it seems to nue nimre pnrrtrcaL to attempt:iro 
immediately buttress local on-the-job evaluatiosi practices. 

Question: Isn't on-the-job evalmation really done throi^ ;a probationary 
period, and isn't that really an employer precrjp[tive and r^ot a state prero- 
gative? 

Answer: Yes, that's trner. .anri ag^iin, my poui? is th;a:t untili the state is in a 
position to apply uniform statre-wade criteria th:i': ^I'r vaKdaied in a meaning- 
ful sense, I do not see iaow it can interfere wcrr^ j itacal enirployer. The fact 
that local evaluations necessarily are classroQiu amdi .closer to actual 

instructional needs means:thfat local evaluatian,:iitiiK3St^otemtia4ly , is more in 
tune with the aims of CKIE- .I agree winh yo,u,:=i^^4iOTi^^ currently 
being adequately undertaaEcn jin mmst cc^^T^^^niirmjst&A. bmir^my pcmit is that im- 
mediate attention and eEfiairtTshamildibo Mmrcditivwart^ihis area, which gives 
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a promise of greater immediate feasibility- 

Qaestion: You talk of different staoidards in every district of the scaie. E 
run a teacher seeking a job, or an adiniiiistiaitor, am I not bemg discrinsinatef: 
against if there are, in fact, as many diffetsnt standards as there aie disJtricji" 
or schools? 

Answer: Not if the standards are clearly articula^xjd, and. ate applied iM^jy 
and objectively. I know that is saying a lot. 3*reseainy (at least in thjeorvf^i 
there is one set of standards in New York, and another set of standaiciSLan 
Colonado. Is lhat discrimination if a teacher who: ^as trained in Colxiasiii;^ 
(floes not qualify under New York standards? 

Questtion: Whiat has; been the position of the teaclasff. umionsiii your licsasai^ 
cases and what are the politicail implications of :5aEiurts getting involvedom 
these cases? 

Answer: As far as the unions' position in dan: Jitigations thait I've beec: 
involved with, in both the New York City supesrvmo^' licensing case and im 
the teacher licensing case, the umions interveisedHjaitdhe side of the deffiencj- 
ants, and fought vigorously to U3)hold the exisdngilliEansitig systcim/Inmamv 
ways, they fought harder than the origpial defendants ■ themselves. Intetfestt- 
ingly, in Chance, the case was brought agaiIlSt.lmI^h th!g^ ^felW^ York City Boa^ 
of Examiners, which is a separate statutoi%^-^«KtaMU«hed -^ncy/, smai oSter 
Board of Education and its Qiancellor. The BoaitiiG?f Education did not^it^ir 
up a i^orous defense and the Chancellor, in facctrefussed to defend: thRxaar 
and ejvCT submitted an affidavit to the cxjurt sayii^ t&atthe peisona% fevcsmd 
the po^on of the plaintiffs; he mplentienfed the ISkmsins^ system teaiusei^ 
was required to do so by state statute, bun he ^ofit^imrwii:^ 
the systsm before the court. The Board of Xxairiain^Brs..^injw«yerv^2S2^^ 
defend the action to the maximunt extfintpossibiee Tflineeoir four^cearsiiiffiBi.. 
w3ien the teacher licensing case sfimilarty htwi^M agstost tfeffcsamoj-dte- 
fendants, the Board of Educaticm as \»rell as; thecnew Chanjccellocnseiciteiiti: 
vigorously defend the action, and that case isstill-TiFgiTgiiig. Lesion 'tikttowrwtet 
was the reason for this change of position, -fediami^vir ^^as liiecauaie thei:2anE-' 
position of the board and the chasicellorshiEr chafrtsyjJL..Tngiiia ps i3^:pc33Biicaii 
climate shifted over the years, or it may^w tliar::ntnc>' thougErrrth2t:ttiEi: 
teacher's exam was more validuthan Ae supervisor's «5GEitnrhad beer*. 

Turning to the larger question of involvement of the courts in tia? 
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politics of educ£3ioa, I would first note that the court's involvement was not 
self-motivated. One might say that Congress invited or required them to get 
involved by paging Title VII and by extending it to local governmental 
agencies. Now imevitably, if a court rules that a licensing system is unconsti- 
tutional, its csn-going supervision of the implementation of new system be- 
comes quite extensive. The Chance case, as I mentioned, has been in litiga- 
tion for iive years, and essentially, over that period of time, the Federal 
District Count has become a co-administrator of the entire New York Gty 
school system. There is almost no important decision regarding supervisors 
that can be mads in the city without the court's involvement- For example, 
last fall the systean was faced with the prospect of massive position reductions 
because of bujflget cuts. The plaintiffs alleged to the court that the contractu- 
ally-mandated: seniority lay-off system was in conflict with the court's ruling 
in this case. Theiy said that the court intervened, minority supervisors who 
presumably were prevented from being hired and from accumulating senior- 
ity by a discrimiinatory examination system would be the first to be laid off. 
So no lay-offs fnave been effected while the court has deliberated on this 
issue, and the lengthy appeals procc^ss has been completed. 

On lUhe other hand, the courts are very aware and very wary of their 
political i^ble and their involvement in day-to-day administrative decisions. At 
every stags in the case the judges (over the past five years, there have been 
three of itiem) Jsave constantly attempted to narrowly define the issues and 
to lesve asrmucbh discretion as possible to the school administrators, but the 
nature of the sauuation sometimes makes this impossible. This attitude may 
explain why com tent validation has been accepted as a reasonable interim 
procedure by ±e courts. If the more demanding predictive validation 
standard were to be applied, the courts might feel that they would never be 
able to terminal::^ their oversight role. 
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TECHNIQUES AND CRITERIA FOR DESIGNING 
AND SELECTING INSTRUMENTS FOR 



ASSESSING TEACHERS 



By Pauls. Pottinger 

Paul Pottinger is a Senior Associate and Director of Assessment Systems 
at McBer and Company in Boston, Massachusetts. He is an experienced clini- 
cal and social psychologist whose background includes university level teach- 
ing and significant work in the practical application of the^behavioral sciences 
to organization, manpower, and management problems. Additionally, he has 
had considerable experience in the plaiming and management of research 
programs in the U.S. Department of Health, Education and Welfare. 

Pottinger's special interests and expertise are in the design and imple- 
mentation of assessment systems where the identification and measurement 
of individual competence related to work and other social roles lead to equal 
employment opportunities and organization effectiveness. He has success- 
fi»lly utilized social psychological techniques to assess individuals' educa- 
tional and training needs and in individual evaluations related to selection, 
placement, promotion, certification and licensing. 
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TECHNIQUES AND CRITERIA FOR DESIGNING 



AND SELECTING INSTRUMENTS FOR 
ASSESSING TEACHERS 
By Paul S. Pottinger 



The Problem in Perspective 

More than ever, teacher educators want to know and need to demon- 
strate whether or not they are accomplishing the goal of prepaiing people 
effectively for teaching. The development and use of assessment and evalua- 
tion techniques, however, have not kept pace with the need for better 
answers to these fundamental questions. 

Three years ago, David Krathwohl (Merwin, 1973) stated: 

One can predict that performance-based teacher education 
(PBTE) is certain to fail to reach its ultimate objective if it con- 
tinues on its present course. This failure will be caused by the 
almost complete lack of attention given to the assessment of 
teaching competencies, a core concept of PBTE. Only by such 
assessment can we achieve the goal of assuring that a teacher can 
indeed perform in ways that result in children learning. (Italics 
mine.) 

Merwin went on to say in this same publication: 

Indeed, the ability of trainers to adequately define and measure 
competency lies at the heart of the question of whether PBTE 
can be successful. 

Dr. Krathwohl further commented that there is a paucity of instru- 
ments available for assessing teachers. This is still true today, and it is one 
reason, no doubt, that I have been asked to address this group on criteria 
for development and selection of instruments. My comments will focus 
primarily on development, partially because I am aware of few relevant 
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instruments from which to select. 

Others have written eloquently about the problems of PBTE(see espe- 
cially Broudy, 1972 and Merrow, 1974). Still others have discussed issues of 
assessment research which provide useful criteria in the development or 
selection of instruments (see for example, Merwin, 1973; and Medley, Soar 
and Soar, 1975). I will not attempt to summarize these readings since you are 
no doubt familiar with them and many others already. 

• This presentation will: 

— briefly discuss a variety of perspectives that impinge upon 
assessment and performance -based teacher education. 

— suggest a conceptual model for meeting the simuhaneous 
demands of those who have different perspectives yet are 
in search of a common ground for achieving practical solu- 
tions for validating teacher competencies. 

— discuss some specific assessment instruments, developed or 
utilized in a variety of educational and occupational set- 
tings, which serve as prototypes and models for new instru- 
ment development and selection. 

Background-Social vs Scientific Impetuses for Change 

The impetus to change assessment of teacher performance has come 
primarily from the courts, taxpayers, and educational consumers. This impe- 
tus has culminated, in New York State at least, with Commissioner Nyquist's 
challenge that we must assure the public that graduates of accredited teacher 
education institutions are more competent than non-graduates. Performance- 
based teacher educators are trying to instill public confidence in teachers' 
competence by empirically validating specific behavioral objectives. Research, 
theory, and development, however, have not kept pace with the social, poli- 
tical, and legal requirements for change that are being imposed. 

While we should welcome incentives for change, we should recognize 
them as a mixed blessing. New York's validation ge l is a frightening proposi- 
tion for higher education researchers who find lit; support for the rigorous 
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research needed to meaningfully validate teacher competencies. Government 
and pnvate sector funding sources as well as program developers and research- 
ers are responding more to the social forces for change than to rigorous 
empirical (i.e. scientific) quests for better, more practical solutions to com- 
plex problems, PBTE efforts have reflected a reactive movement in response 
to simple and minimal court demands for content validity and quick answers 
rather than a proactive movement in response to fundamental scientific 
demands for better knowledge of cause and effect relationships. If we at- 
tempted to answer these more fundamental questions, the issue of predictive 
validity, rather than mere content validity, would receive more attention than 
it now does. 

Thus, social pressures have led educators into attempting to clarify 
objectives, goals, and outcomes without first establishing a strong methodolo- 
gical base from which to make reasoned decisions. Such decisions are instead 
being made from considerations which lack the vision, concepts, and methods 
necessary to meet meaningful, long-range assessment goals. 

Performance-based teacher education appears to be a rational approach 
for making program and individual certification decisions. Its efforts to date, 
however, have fallen quite short of meeting the needs for a system that is not 
only defensible in the courts but, perhaps more importantly, defensible to 
students, teachers, taxpayers, program developers, and others who want to 
know what constitutes effective teaching. 

The courts are not requesting the quality research needed to answer 
fundamental questions of cause and effect relationships because their analy- 
ses, albeit systematic and rigorous, are aimed instead at assuring due process. 
That is, the court's rightful role is to demand fair processes of decision- 
making within a framework of what is known. The researcher's role, in con- 
trast, is to improve upon this knowledge base rather than to assure fair and 
equitable use of it. As long as educators respond to the rigor and logic of due 
process rather than to the rigor and logic of science, PBTE will not withstand 
the challenge of the courts any better than standard or traditional educational 
processes. 

One cannot ignore the social pressures for change which arise from 
legal, economic, political, and other social conditions of the day. But we must 
be clear about the differences in goals and strategies for change which these 
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forces create. The education researcher may be interested in validity, theory, 
methodology and other scientific concerns which are of little interest per se 
to taxpayers or the courts. A teacher may be primarily interested in being 
fairly assessed for a broad range of knowledge, skills, abilities and other 
characteristics that constitutes his/her competence; the teacher is appropri- 
ately more interested in comprehensive and fair assessment than in scientific 
issues. The education administrator must be concerned about accountability 
demands from accrediting organizations. The State Board of Regents is con- 
cerned with accountability demands from the courts and the public in gener- 
al. And the student and his parents want more for their consumer dollar than 
is often demonstrated by our teaching institutions. Each perspective is 
legitimate, but no one perspective should be allowed to dominate our strate- 
gies for solving the problems which ultimately each of us shares. Adequate 
criteria for selection and development of assessment instruments should keep 
these differing and relevant perspectives in balance. To maintain this balance, 
we need competent integrators who can translate the critical needs of practi- 
tioners, administrators, parents, students, and the government into practical 
scientific approaches to problem solving. 

The Researcher's Perspective 

For the researcher, a more salient problem than maintaining a balanced 
perspective is, frankly, defining what competence is. And that is a particu- 
larly delicate issue if one considers measuring teacher competence in terms of 
student outcomes. Let's look briefly at some real-world barriers to answer- 
ing this question satisfactorily. 

The objective of schooling, for example, becomes relevant to defining 
competence in terms of student outcomes. Is the objective to foster the 
general transition of children into adults? Is it to prepare people for the world 
of work? Is it to function as a socio-political-economic gatekeeper with 
respect to who attains further educational and career opportunities? These 
questions represent philosophical and ideological strata which are more prop- 
erly the domain of values than of science. 

Assuming there is agreement about the objectives of schooling, we 
would then ask what student outconies are appropriate to these objectives. 
Are they primarily having a grasp of the three R's? Or do they include inter- 
personal competencies? Are they critical thinking and problem solving 
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abilities? Are they moral behaviors? Do they include the constructive and ef- 
fective use of power or an orientation toward achievement? If we can answer 
the first set of value-laden questions, we can at least begin to answer the 
question of appropriate outcomes with some empirical rigor. Until we'^have 
done so, we cannot very meaningfully ask what teacher behaviors and other 
characteristics best enable these learning/development outcomes. Yet, little 
progress has been made toward developing rigorous, useful and relevant 
operational definitions of student outcomes. No wonder there is simply no 
good evidence to relate teacher behaviors to student outcomes. 

The reason there is so little evidence to provide us with fundamental 
knowledge about what works is, of course, the sheer complexity of the 
problem. There are too many unknown or uncontrollable variables. Students 
differ in their basic behavioral repertoires, socio-economic backgrounds, 
motivations, interests, values, and perceptions of their environments. Teach- 
ers also differ according to these and other important dimensions. Rnally, the 
environments within which teachers and students interact differ according to 
numerous physical, psychological, organizational, social, economic, and poli- 
tical dimensions. Medley, Soar and Soar (1975) have eloquently presented a 
model for conceptualizing the complexities created by these variables, and 
they have elaborated on the implications of these obstacles for doing re- 
search. We will refer to their four-level paradigm for conceptualizing research 
in the next section. 

One reason for elaborating on the socio-political context of compe- 
tence assessment as well as on the scientific complexity of the problem is to 
make two points more salient. That is, (1) we cannot meaningfully discuss 
criteria for developing or selecting instruments for assessment without agree- 
ing upon the context or paradigm from which we operate together. Part II 
of this presentation will briefly describe the paradigm from which I am 
operating. Suffice it to say here that selecting and developing measures of 
competence is to my way of thinking, putting the cart before the horse, since 
there is little or no scientific evidence about what constitutes competence 
in the first place. (2) More systematic collection and analysis of data is re- 
quired of all of us if we are to make agnificant progress toward the goal of 
empirically validating teaching competencies by 1990. We need not, by the 
way, agree upon philosophical and ideological issues in order to do empirical 
research. Also, heavy emphasis by researchers on rigorous scientific analyses 
of competence should not denigrate practitioners. Many practitioners have 
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strong convictions about what constitutes quality education, but they are 
unable to empirically validate these convictions. We should not belittle them 
for assessing student competence on a subjective basis; rather, we should 
tap their intuitions and covert working hypotheses to uncover clues to the 
causes of successful teaching. 

The plea for more scientific research stems from the belief that such 
research is critical to the development of quality PBTE programs that are 
attempting large-scale change in the way they teach, assess and credential 
students. Moreover, the outcomes of quality assessment research could re- 
place legal and political pressures as the **prime mover" in accomplishing the 
changes. 

Performance-based teacher education will not progress very far 
unless it is able to move beyond the subjective assessment of the **laundry 
lists" of behaviors which proliferate the field. No matter how strongly current 
curriculum and assessment innovations are supported by the courts and 
others who demand equity and accountability, PBTE must provide scienti- 
fic evidence that it works better than the status quo. The barriers to de- 
fining and measuring competence will not be eliminated by arguments for 
change and innovation no matter how strongly they side with equity, 
accountability or other relevant social goals. The outcomes of PBTE must be 
developed and evaluated systematically, rigorously and scientifically. 

Most new attempts to define and measure learning outcomes accord- 
ing to what people can do are restricted in scope, lack rigor "or poorly 
correlate with job and life requirements. The state of the art of assessment is 
in need of more conceptual rigor, systematic and comprehensive strategies for 
developing measures, and empirical verification of the utility of these meas- 
ures. 

Until we have a more comprehensive base, educators will continue to 
use an existing array of questionable measures based on narrow cognitive 
outcomes^ superficial behavioral observations, and a priori value-laden judg- 
ments. What is required is a sophisticated technology capable of uncover- 
ing critical factors which are necessary and sufficient for competent perform- 
ance. " 
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Criteria for Assessment Instrument Development: 
Locating a ''Rational Center"" 

Moving from Behaviors to their Causes 

The one criterion I wish to emphasize is that teacher competency defi- 
nitions and assessment instruments should comprise causally related, criterion 
referenced and generalizable variables which take into account complex 
observable and unobservable behavioral repertoires required for successful 
performances. Underlying this statement is intuitive, theoretical, and empiri- 
cal evidence supporting the notion that competencies cannot be meaning- 
fully defined by seemingly endless lists of specific skills, tasks and actions 
which ultimately fall short of real-world requirements for effective perform- 
ance. In fact, the more essential characteristics for success often turn out to 
be broad or generalized abilities and characteristics; and they are sometimes 
more easily operationally defined and measured than an anay of specific 
"subskills" which do not add up to general competence. 

Most PBTE assessment techniques are based on the observation of 
external behaviors which are the building blocks of successful performances. 
But these assessment techniques tend to be reductionistic and lacking in 
meaning because they fail to assess the underlying causes of these behaviors. 
Usually the result is the assessment of behaviors which may have little gen- 
eralizability or transferability to a variety of teaching requirements. This 
problem has important implications for curriculum and instruction, because 
observable but superficial behaviors rather than their causal underlying 
factors often are taught. Thus, what is actually learned, as well as what is 
assessed, may have little general significance in post-academic life. • 

This bias will arouse strong feelings in many supporters of the PBTE 
behavioral objectives approach to competency definition and measurement, 
so I will try to put this criterion into an historical as well as methodological 
perspective. 

Again, differing perspt^Jves of program developers must be taken into 
account. I hope to find some practical middle ground, not because itis safe, 
but because I think that recognizing the major thesis, the need to measure 
causal viables, can potentially lead to pragmatic solutions for finding what 
Menow (1974) calls a "rational center'" in PBTE. 
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Further Background: 

Reliability and Specificity vs. Wholism and Relevance 

A basic tenet of PBTE^as I understand it, comes from the Commit- 
tee on PETE in its sixteenth publication^entitled, "Achieving the Potential of 
Perfonnance-Based Teacher Education: Recommendations," (1974). This 
document states, 

The unique strength of PETE is that it challenges all who 
touch it to be open about their intentions and explicit about how 
they will decide if their hopes are fulfilled,. Ends must be made 
explicit; means must stand the test of relevance. The lo^c of the 
performance-based approach places a healthy stress on the use 
of evidence to test one's ideas and assumptions. In these consi- 
derations lie what the Committee believes to be its great poten- 
tialities (p. 29). 

The interpretation and implementation of the spirit of this statement 
has often come from an accountability (social-economic-political) or due 
process (legalistic) frame of reference. These interpretations have been par- 
tially responsible for the formulation of competence definitions in terms of 
a plethora of professional judgments, documented by a morass of high speci- 
fic but unvalidated competency statements. The lack of rigorously demon- 
strated relationships between competency statements (or measures) and 
educational outcomes has not been a serious problem for those who view 
PETE as a short term pragmatic remsdy to problems of accountability. Nor 
hasv.this troubled those^ who^ew PETE as a remedy to the courts' request 
fMTTontent valid assessmentidevices for licensure. 

Some program develooffirs have been led away from accounting for the 
richness and complexitg^ aSfauman behavior in their curriculum and assess- 
ment procedures by bctoviorism or the 'tyranny of reliability." They have 
faUen prey to the specific behavioral objectives approach because they 
believe that molecularimg global behaviors into "submits is theoretically 
sound. Or they believe that this reductionism makes behavior more amenable 
to objective observation, which, ipso facto, solves the problem of reliability. 
Merwin (1973), however, pointed out three years ago that one need look 
only briefly at the most comprehensive collection of statements of teacher 
competencies available at that time, to ascertain their insufficient implica- 
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tions or directions for objective observaaion. He concluded that, 

Acting only on these competency statements, it is highly un- 
likely that two trainers would jidcpendently structure the same 
assessment procedures or that two observers would attend to the 
same aspects of performance (p. 12). 

These comments appear to be as applicable to current competency state- 
ments as they were three years ago. That is, competency statements are not 
providing an adequate base for designing behaviorally specific assessment 
instruments. 

Perhaps this failure is a blessing in disguise, for it provides us with 
incentives to take stock of this atomistic/reductionistic approach. Even if 
reliability can be increased, which some research studies have found to be 
the case, the relevance of rated behaviors seems dubious. 

Implicit (and sometimes explicit) in this approach is the assumption 
that the acquisition of microskills and abilities. adds up in some linear and 
simplistic fashion to overall competeroce. Th^is;Jughly valuedgeneralizable 
skills are assumed to be mere summatrons ofriiteiability to perfomm objective- 
ly measurefflJie.andSiighly specific sub-tasks. 

Brou^'s-(19S2) criticism of this assunaplion is useful here. The belief 
that the whdesEis merely the sum of the parts 

is a-naanriously inadequate description of any human action, let 
alone -QBE^ so complex as teaching. Teaching can, of course, be 
thoughtrof as broken down into parts, but as a concrete action 
it is guided at every moment by a sense of its total pattern. This ' 
pattern— in swimming, reading, classiiying, judging— integrates 
the analyzed constituents into a meaningful functional sequence, 
not merely a mechanically additive one. We are told, at least by 
some psychologists, that after the pattern has been sensed or felt 
or understood, the details can be perfected separately, but until 
the pattern has been discerned, drilling on the separate parts 
yields disappointing results (p. 3). 

I think Broudy has written eloquently on this concept of the whole 
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vs. the parts, I shaii take the liberty to quote him further. He discusses the 
limitations of behaviorally specific proscriptions for teaching performance in 
the context of three teaching styles: the didactic, heuristic, and philetic. 



Didactics refers to the impartation of knowledge by the 
teacher to the pupil; heuristics refers to the effort to help the 
pupil discover for himself either the contents of a body of kno wl- 
edge or the methods of arriving at such knowledge and assessing 
it; philetics is merely a Greek name for love or securing rapport 
with pupils or, as the cunent jargon has it, "relating to pupils." 

Performance-based programs can accommodate didactics, 
which aims at more or less rote masUery of a fftpertoire of expli-. 
citly formulated knowledge and skills Heuristicrnnd philetic teach- 
liiig do not itod themsdves to the preciseaaalysis, specification, 
and evafluatioa which is the presumed gloE^ offthe PBTE, Apro- 
pos o&whi£h,JDne mig^ remind the namessiof teaching machines 
that JSataiamii:Socrates were exemplars cifheuristics, not didac- 
tics, 

Wheir a fairly reliable measure of baaming is available-as 
it is in jdniactics-we can take a Skinneaan position and say, 
"Givenr^ifeachsr performance P, there wiH ensue pupil perform- 
:ance S*,"jand ;we can perhaps ignore (fatmheaven alone knows 
^at concomEtant learnings take placed whatever intervenes 
ibetween E :and: S in the minds and hearts of pupils, teachers, 
parents, aird.sciiool boards. This is the toi^line adopted by the 
:proponents of behavioral objectives, education contractors and 
contractees, and the directors of the budget local, state, and 
national. Such toughness makes no sense in heuristic and philetic 
teaching, where learnings are insights and transformations of atti- 
tude for which unambiguous behavioral indices are hard to find, 
inasmuch as tolerance of ambiguity and lack of structure is an 
avowed outcome of philetics. What behavior, for example, shall 
we regard as criterial for a pupil's insight into his hostility to the 
teacher? 

Success is heuristic and philetic teaching cannot be judged 
by prespecified appropriate pupil behavior because such behavior 
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—even when we can identify it— is not manifested on demand 
or at a specific time. Critical thinking, the use of the imagination, 
warm feeUng toward peers, achievement of identitycannot be 
inferred from one segment of behavior iised:as a test pattern. And 
what pattern shall we use as a:test? Indeed, the vulnerability of 
general education to attack lies in the very fact that many of its 
benefits do not appear until fairly latte in life. Ournspeech and 
reading habits, a thousand attitudes, oiur interests often represent 
the tacit functioning of explicit laming inputs made during 
school and college, but which we caaaio longer recall, This may 
help to explain why correlations::between academic achievement 
and success in life are so low. The-iacademic grades measured 
learning of items that have since been largely forgotten; func- 
tioning now are the residual conceptiial and affective schemata, 
which were never tested on examinations. Nor need it be added 
that the life outcomes we claim for heuristic and philetic teach- 
ing are from the first contaminated by noninstructional variables, 
which we are never able to control adequately in our research or 
schooling (pp. 5-6). 

A conclusion reached by Broudy inzilhis same document is that how 
often one has performed a specified task or over what range may not be so 
important as the ability to perform a^vanation of the task not previously 
practiced. Broudy discusses this in the comtext of teacher training, but its 
implications for assessment strategies are congruent vwth my central thesis. 
Unobservable but measurable generic and causal linking variables of behayior 
are equally if not more critical than observable behaviors for defining and 
measuring competence. Broudy's example of a teacher whose task is to ex- 
plain Boyle's law further captures the essence of this thesis: 

Suppose the prospective teacher recited the explanation of 
Boyle's law verbatim as it was put down in his texttjook the 
teacher's manual. Suppose hfi got ^ his pujiils to .^do likewise. 
Would ttot this be proof of performance competence? Suppose, 
in addition, he could do all the exercises dealing with Boyle's 
law at the end of: the chapter, and supposermost or all of his 
pupils could do likewise. What more definite and objective evi- . 
dence of competence could one want— if that is the competence 
one wants? Yet it is clear that such a performance could be 
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brougjit off without either the teacher or the ptqjils "undenttand- 
ing" Boyle's law. (Ind^d, many generations learned geonnetry 
in precisely this way.) ^ a matter of fect,,a demonstratioEi that 
would really satisfy usithat ''explaining" Boyle's law hitfltbeen 
performed adequately would not be any specific prescfeduled 
behavior. On the contrary, some sort of dialogue with'pupUs 
that allowed us to infer— not observe-that the basic netojf con- 
cepts we call chemistry is understood by both teacher andrpupUs 
is needed. The kinds of examples and counter examples; tiie way 
pupil questions are interpreted; the cues used to set the pnpil on 
a more profitable course; not the performance but the :stste of 
mind we call understanding is the crucial "product" heie. No 
single observable behavior is likely to be sufficient proof of such 
adequacy, for a state of mind is not observable behavior. Skinner 
quite rightly doesn't worry about whether his pigeons under- 
stand what they are doing so long as they do it. If, however, the 
way a situation is perceived or interpreted is in any way an 
important ingredieiit of teaching or learning, then verbal behav- 
ior, or any. other covert behavior, maynot be sufficient indicators 
of either successful teaching or learning. In other words, perform- 
ance-based teaching is in danger of capturing everything except 
what is most significant in many kinds of learning, viz., signifi- 
cance (pp. 10-11). 

The implications of Broudy's comments for developing assessment 
instruments are many. The basic conclusions might be summarizediMtifiaBow: 
The preoccupation with specificity, clarify aod pEeaasljdii oFtbeflavioBitt 
objectives has left us with an aperatioMl pantdtgmfor deSiling anoliiifiasurzag 
teadiing competencies which is intuitively -and theoretically oweraanpIifKd 
and in\^d. Lengthy checklists of highly specific *low-inference!*tbc&avi0ial 
outcomes— even when properly sampled, factor .analyzed, and inte^eted-- 
have been found empirically (though not yet_leg^y)i3nsafflcient foEryalidat- 
ing competence. Rigorous behavioral obseryatioiisnfa2ato adequate assess 
either complex interactions among variables or underlying causes oScompe- 
tent teaching performances. Too often qualitiesrofithe mind andxSaracter, 
unamenable to direct observational techniques, account for the presence or 
absence of competent performance. 

The alternative to the behavioral objectiv^ paradigm appears to be am 
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operational system that leads to vague, abstract, and unmeasurable outcomes. 
Yet, our intuitions as well as empirical evidence tells us that competence is 
comprised of non-additive, non-linear, complexly interacting variables— some 
of which are not directly observable (see Medley, Soar and Soar, 1975 and 
Gage, 1976). 

Causally-Related Criterion Referenced Measures: 
The RationaltCenter 

What is needed, then, is a model for defining operationalizing, and 
measuring competesace that combines the methodological rigor of the behav- 
ioral objectives approach with the richness of our intuitive, empirical, and 
theoretical knowledge of what constitutes competence. 

One model for doing this has been developed by David McClelland, of 
Harvard University, and his colleagues. Its success has been demonstrated in 
a variety of occupational areas. As it is applied to teacher competencies, it 
assumes that more important than either the storage and retrieval of informa- 
tion or the frequency and range of tasks performed (as specified in behavioral 
objectives) are hosts of covert behaviors which are antecedent or causally 
related to successful behavior. For example: how able are people in process- 
ing new information for problem solving; how able are they in integrating 
this infonmatian to ^mm new solutions; and how able are they in implement- 
ing these.solutiK)ns. 

The distinguishing characteristic of this model is that it attempts to 
define competence in terms of causal variables of competent behavior rather 
than inrterms of external behaviors that are the observable manifestations or 
"building blocks" of competence. Such behaviors may correlate with success, 
but correlation or mere relatedness does not imply causation, a fact almost 
completely overlooked in the behavioral objectives model of PBTE. Specific 
behaviorsanay be statistically associated with teaching success, but it does not 
follow that these behaviors lead to success; they may have followed it. Thus, 
ICA's model is aimed toward defining and measuring characteristics which are 
not only statistic^y related to outcomes, but in fact, cause them. 

A major assumption of this approach is that knowledge, and skills that 
caii be defined in terms of behavioral objectives are seldom sufficient indica- 
tors of how well a person will perform as a teacher. There are many other 
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factors that relate to performance but are not tapped by behavioral observa- 
tions. These include, for example, motivation, diagnostic listening abilities, 
empathy, the ability to think clearly under stress, the ability to anticipate, 
analyze and solve problems, the ability to be flexible in teaching style, and 
many others. Often these factors are intuitively obvious as critical to teaching 
success, but they are rarely measured effectively if at all. It is these and other 
variables related to complex teacher abilities that causally-related criterion 
measures are designed to assess. 

PBTE has successfully broken away from the limited assumptions that 
knowledge of teaching theory alone is sufficient for developing competent 
teachers. But it may have swung too far to the opposite extreme of only 
teaching behavioral tasks. Neither the knowledge of how one should teach 
nor simple demonstrations of behaviors gets to the heart of competence. We 
must establish links between the knowledge and behavion that constitute 
successful performances and the causes of these performances. 

The ICA Model 

What causes a teacher to utilize knowledge and behaviors effectively? 
ICA's operational model for answering this question would encourage one to 
raise new hypotheses about these causes and to validate them. For example, 
if what Broudy calls "insights and transformation of attitudes" or "residual 
and affective schemata" are important to effective utilization of behaviors, 
we must try to operationalize and objectively measure these causal variables. 
Such hypotheses might well come from observing or analyzing the heuristic 
and phietic aspects of teaching. We must recognize that "sensed patterns of 
behavior," and "perceptions and interpretations of situations," are causally 
related to successful performances. Educational researchers must begin to 
operationalize their hypotheses about these causes and see if their measures 
differentiate superior performers from average or poor performers. These 
measures should be objective, reliable, and amenable to statistiujal analyses, 
so they can be construct validated and empirically related to. successful 
performances. (For further discussion of determining the meaning of 
measures through construct validations and criterion referencing, see Ap- 
pendix B.) 

Attention must be given measurement of what many researchers treat 
as "extraneous factors." Often it is these factors, considered by some to be 
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merc;/ undesirable "noise" in the system, that contain rich clues to the 
cauiM*"^; of competent performances. These variables are intuitively recognized 
as critical aspects of success, but they hive too often been treated as extrane- 
ous factors, because people don't know how to measure them. Researchers 
must come to grips with these critical causal components of competence. 
Otherwise, PBTE will fail to be meaningful to teachers and others who know 
that more than their repertoires of observable external behaviors are function- 
ing In ilieir effective teaching interventions. 

If an assessment instrument validly taps a causal variable (i.e., differen- 
tiates performers on the basis of criterion measures), then the variable being 
measured diould be taught. In the end, teaching and assessment of compe- 
tence should include factors which cause effective use of both knowledge and 
behaviors in the classroom. For example, a teacher's ability to match teach- 
ing style with student learning style is an important teacher characteristic. 
It makes sense, then, to define, teach, and assess the causal variables or 
factors that lead teachers to make such adaptations. This approach is in con- 
trast to merely articulating, teaching, and observing the morass of possible 
and necessary adaptations that will need to occur. Behavioral observations 
may provide evidence of whether the teacher performs specific adaptations 
under specific conditions, but these observed behaviors may not generalize to 
numerous new situations encountered in the field. 

Furthermore, if the determination of teacher competence is to depend 
upon performances of students, we must expand the range of student learning 
outcomes to include cognitive, affective, and other antecedent causal vari- 
ables. For example, let us assume that an agreed upon behavioral outcome for 
students is their ability to solve problems involving Boyle's law (borrowing 
from Broudy again). It may be more important to instill and assess genersd 
critical thinking and problem solving skills than merely to teach the law and 
demonstrate its use in limited sample problems. It is important that the 
student identify situations where Boyle's law is relevant as well as apply the 
law effectively in those situations- Moreover, the student's achievement in 
general problem solving or critical thinking is more important for adult life 
than is the knowledge and sample applications of Boyle's law out of the con- 
text of life Situations calling for its use. Measures of these more generic 
abilities are begiiming to emerge. They appear to be sensitive to important 
changes in students' learning; and, they measure learning outcomes which are 
important to fair and comprehensive determination of which teachers and 
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which teacher characteristics really make a difference. 

In order to see the importance of t>>:ese measures more clearly, I want 
to present the ICA model more graphically. I am taking the liberty to con- 
trast the ICA model with the one presented by Medley, Soar and Soar (1975). 
This is not to denigrate their model, but to expand upon it. It is the clarity, 
parsimony^ and conciseness with which they presented their model that 
allows me to do this. A brief presentation of their model and quoted ex- 
planation follows:^ 



A Simple Paradigm 

It will be convenient to distinguish four different levels in the 
teacher's professional development at which the teacher may 
be assessed^ as shown in Figure L 



Level I 

Training — > 
Experiences 



Level II 
Teacher — > 
Performance 



Level III 
Pupil Learning 
Experiences 



Level IV 
— > Pupil 

Outcomes 



; Figure 1. Assessment Levels in Teacher Education 

Level I refers to assessments of the training experiences th^ teacher has 
had: What courses has he taken? What modules has he attempted? Which ones 
has he mastered? Which has he bypassed on the basis of having demonstrated 
mastery of its objectives beforehand? 

Level n refers to assessments of the teacher's behavior while he is at- 
tempting to fulfill the role of a teacher. What kinds of questions does he ask 
in interaction with pupils? How does he organize his class for instruction? 
How dees he determine the objectives of instruction? 



This model and brief explanation is taken from Medley, Soar, and Soar, Assess- 
ment and Research \n Teacher Education: Focus on PBTE, PPTE Series: No. 17, Wshing- 
ton, D.C.: American Association of Colleges for Teacher Education, 1975. 
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Level m refers to assessment of the behaviors of pupils under the 
guidance of the teacher being assessed-assessments of the experiences they 
have which we all know must form the basis for any learning that takes 
place. What kinds of tasks do the pupils perform, in or out of class? How 
much time do they spend in active participation in class discussions? How 
often does each child receive reinforcement and for what? 

Level IV refers to assessments of the outcomes of instmction-of those 
changes in behavior tliat it is the purpose of education to bdag about. How 
well does the pupil read? What are his attitudes toward independent learning 
in dult life? What kind of a citizen does he become? 

Each of these four assessment levels is represented in the diagram, 
joined by arrows representing lines of influence or of cause-and-effect. Thus 
outcomes (Level IV) are seen as influenced by, in part the result of, pupil 
behavior (Level III), of learning experiences the pupil has while in school; 
these experiences in turn are seen as at least partly determined by what his 
teacher does (Level II); and, finally, the way the teacher behaves- 
'^teaches"— is affected by the experiences he has had during training (Level I). 
All of these things are, of course, strongly influenced by other factors not 
shown in the figure, e.g., conununity, school, pupil, and teacher charact- 
eristics. 

The whole enterprise of teacher education is, of course, based on the 
assumption that, despite these extraneous factors, the influences that are 
assessed at each stage are potent enough to have an appreciable effect not 
only on the level immediately following but on all subsequent levels. The 
concept of teacher effectiveness, in particular, is based on the notion that 
pupil learning outcomes {Level TV) are affected by teacher behavior (Level 
U). And the justification for the very existence of teacher education is the 
presumption that what happens to a teacher in training (Level I) can some- 
how increase his effectiveness, that is, affect pupil learning outcomes (Level 
IV). 

Implications of the Paradigm 

The very existence of intermediate Levels II and III suggests that the 
effects of training on teacher effectiveness are subject to attenuation and are, 
therefore, difficult to establish. Any impact on pupil learning (Level IV) of 
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teacher behavior (Level II) must be achieved through pupil behaviors (Level 
III). Two teachers who behave identically will achieve the same outcomes 
only if their pupils also behave in the same way. If we attempt to relate 
teacher behavior to pupil learning without paying some heed to what the 
pupils are doing, we should not be surprised to find that the correlations tend 
to below. 

In the same way, the relationship between teacher education (Level I) 
and effective instruction (Level IV) depends on what teachers and pupils do 
in Levels II and III. We must train teachers to behave in such a fashion that 
their pupils will behave in such a fashion that the pupils will learn more! 

The ICA model is presented in Figures 2, 3, and 4, where it has been 
juxtaposed or integrated with Medley, Soar and Soar's paradigm. The inten- 
tion is to make more graphic the importance and possibilities of measuring 
critical causal intervening variables which are often stated as relevant to com- 
petence but rarely assessed or even operationally defined. This model reflects 
the notion that directly observable behaviors are insufficient indicators of 
successful outcomes at the pupil, teacher, and institutional levels. 

Figure 2 demonstrates the notion that there are antecedent and often 
unobservable causal variables that affect teachers' learning experiences, 
teachers' performances in the field, students' learning experiences, and 
students' outcomes. Figure 3 demonstrates the phenomenon of intervening 
causal variables at the level of college-teacher interactions.^ I have focused 
mainly on causal variables at the teacher and student level, but Figure 4 
integrates all levels. It shows definitions, measures, and interactions of exter- 
, nal behaviors and their antecedent and intervening causal variables. These 
causal variables are presented in levels A through D. Their behavioral manifes- 
tations are presented in levels I through IV. Sample measures of both types of 
variables are suggested at each level. 

It may be the more generic causal factors of competence that should 



At the program level there are causal intervening variables that are often dis- 
cussed in terms of organization and management theory, but they are rarely assessed or 
accounted for in curriculum and program development. Rather, the focus remains on 
imparting knowledge and rote behaviors without a clear understanding of how even these 
outcomes can be achieved most effectively. 
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(1) at least partially comprise competency definitions, (2) be taught in teach- 
er education colleges, and (3) be measured in valid assessments of compe- 
tence. This model would consider causal variables as legitimate learning out- 
comes as well as intervening variables. 

Causally related criterion measures may be critical to teacher educa- 
tion because they provide the means for making better empirical links 
between teaching performances and student outcomes. This is so because 
these types of instruments appear to be more sensitive to short term and/or 
more relevant changes in student learning, than standardized achievement 
tests. 

The use of these types of measures can better clarify our understanding 
of what constitutes effective teaching (e.g., critical thinking, problem solving, 
the ability to implement effective solutions) because these measures can be 
made amenable to construct validation and empirical predictive validation. 
These validations are being demanded by researchers to understand better the 
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Figure 2. A Simple Model for Conceptualizing Causal 
Variables in the Teacher-Student Relationship 
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Figure 3. A Simple Model for Conceptualizing Causal 
Variables in the College-Teacher Relationship 



meaning of measures, and they are becoming more strongly advocated by 
EEOC guidelines. They are also being required more frequently by our courts 
of law. It is because of these methodological and legal requirements for 
rigorous validation that behavioral checklists will ultimately have to give way 
to more relevant and objective measures. 

Because causal related criterion measures can help clarify our under- 
standing of what constitutes good teaching, they have important implications 
for curriculum, training and the modification of causal factors that underlie 
the behavioral performances which partially constitute effective teaching. 

To assume that intervening or generic causal variables cannot be meas- 
ured and are therefore unimportant is to take an unprofessional position with 
regard to competence definition and assessment. Researchers like McQelland, 
Winter, Stewart, Klemp, Kolb, Rosenthal, and others are attempting to 
develop valid measures of underlying causal factors. 
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A sample application of the ICA model comes from resparch with 
human service workers in the State of New York. McQelland and Dailey 
(1974) discovered that several factors were responsible for differentiating 
superior human service workers from average ones. These factors included 
(1) faith in the ability of people to change their behavior; (2) the ability to 
observe and diagnose human problems; (3) the ability to arrive at rea'?^tic, 
non-judgmental goals with clients; (4) imagination in thinking of solutions to 
problems necessary to balance clients' needs with department policies; (5) 
persistence in pursuing solutions; (6) the abiUty to remain task-oriented under 
stress; and (7) the ability to get People to work together in a variety of 
liaison activities.^ 

In contrast, if one accepts the job description of a human service 
worker as a statement of behavioral objectives, the requirements for compe- 
tence appear strikingly different. They describe only the behavioral marufes- 
tations of the seven factors listed above, such as "work in a counseling rela- 
tionship with clients," "establish rapport," "make informed referrals when 
necessary," "make telephone and personal contact with agencies and services 
for and about clients," "have knowledge of specific community environ- 
ment," "process benefits for cHents within frameworks of department poli- 
cies," and "make home visits." This is only a partial list. The point is there 
are few if any indicators of the abilities and other characteristics required to 
perform these tasks competently. Thus, it was more meaningful to discover 
and measure the generic causal variables that led to successful behaviors than 
it was to discover, endlessly document, and rate the specific behaviors them- 
selves. 

These findings are interesting because of the way they parallel those 
of education researchers. For example. Gage (1976) found that enthusiasm 
of teachers and teachers' acceptance of students' ideas yielded positive rela- 
tionships with student achievement. Organization of teachers' presentations 
and teachers' use of "higher-order questions," however, were not related to 
student knowledge or comprehension^ Yet, often, the latter two types of vari- 
ables are included in competency statements. Furthermore, they are taught 
and assessed as if they were valid indicators of competence. 



Measures of these factors were developed and have been validated with other 
human sendee delivery personnel in the Massachusetts Civil Service Systems (McClelland 
and Klemp, 1975), and in Navy training centers (Klemp, personal communication). 
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Clearly, our intuitions about what constitutes effective teaching must 
be empirically verified- And we must not elinunate the verification of vari- 
ables vAiidi are intuitively important but difficult to measure. Such variables 
may constitute the very heart of competence. Measure* of these variables 
that are objective, construct validated and empirically linked to successful 
teaching might provide the means for clarifying competency definitions and 
the means for validating these competencies to the satisfaction of everyone 
concerned. 

Let me summarize what is needed to establish criteria for developing 
and selecting relevant cost-effective and valid assessment instruments before 
presenting some examples of new instnimeats. 

(1) One need is for new conceptual frameworks to guide our thinking 
and processes in identifying, operationalizing and measuring competence. 
These conceptual models must emphasize the underlying causal variables that 
lead to observable behaviors rather than to new ways of simply cataloging 
and oversimplifying the morass of complex behaviors involved in the teaching 
process. 

(2) Better techniques are needed for developing measures which tap 
these broad-based, generic, or generalizable causal factors. They must empha- 
size the quantification of outcome criteria so that educators can rigorously 
and meaningfully validate these measures. They must emphasize new methods 
of assessing performance rather tha^ the predominantly subjective observa- 
tional checklist techniques or the passive and respondent methods (such as 
standard paper and pencfl knowledge recall tests) now in use. 

(3) Practical methods for validating new measures are necessary so that 
institutions of higher education understand the meaning of their assessment 
measures and techniques. These methods m\ist include construct validation. 

(4) New measures must be referenced to criteria which reflect require- 
ments for teaching success if the real nieaning of measures is to be relevant. 
These relationships must not be mere correlations between observable behav- 
iors during assessment exercises and successful behaviors on the job, but they 
must reflect causal links between learning and success, 

(5) Measures are needed which (a) are sensitive to short-run changes, 
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(b) provide liseful feedback about the progress students are making toward 
their learning goals and (c) enable teachers and administrators to develop and 
evaluate better curriculum, teaching techniques, and supportive mechanisms 
for developing competent teachers.^ 



Prototjrpe Measures of liberal Arts Learning Outcomes 
and Other Competencies Related to Teaching 



This section will describe some prototype measures which ICA has 
developed or utilized in liberal arts higher education programs and in other 
public and private sector organizations. Since they were developed or utilized 
in a variety of educational and occupational settings not all will have applica- 
biUty to teaching competencies. 

These descriptions were prepared by Dr. George Klemp, the Director 
of Research at the Institute for Competence Assessment as part of a proposal 
to develop a consortium of liberal arts competency-based colleges. The spe- 
cific relevance of these measures for teacher competencies has not teen 
articulated. Therefore, the present audience might find it meaningful to 
examine them in terms of understanding the types of measures ICA's empir- 
ical operational model develops or selects. Nonetheless, some of these 
measures are potentially quite relevant to teacher competencies, and these or 
similar measures should begin to be utilized in teacher education programs. 
ICA hopes to expand its iCpertoire of relevant measures for assessing compe- 
tence over the next three years. This repertoire will be catalogued and dis- 
seminated. Aggregate data from their use will be analyzed and made available 
to the public. 

By way of introduction, ICA discussed in its proposal the need for new 
measures which (1) are sensitive and relevant to important learning outcomes 
of liberal arts educators; (2) have general significance to a wide variety of 



The issue of establishing criterion levels or performance standards has not been 
discussed in this presentation. A brief discussion of this problem adapted from Pottinger 
and Klemp (1976) is presented in Appendix C This discussion further aigues egainst 
simplistic assumptions of additivity and/or linearity in assessing specific behaviors to 
determine overall competence. ^ ^ 



career and life outcomes; (3) have practical utility for educators; (4) are 
methodologically and technically innovative, e.g., utilizing operant rather 
than respondent behaviors; and (5) are quantifiable and thus amenable to 
rigorous detemiination of reliability, validity, and meaning. Using these 
criteria ICA has developed innovative measures which attempt to answer the 
need for more "proactive" (operant) measurement techniques to assess the 
factors of process, integration and implementation. 

The purpose of this section is to present information about particular 
instruments which have been designed to measure competency-based out- 
comes. A subset of these measures are discussed in depth, and data relating 
those measures to academic and real world outcomes are presented- For the 
sake of clarity, and consistent with the competency-based orientation toward 
outcome-relatedness, the measures described below are organized according 
to three outcome domains: cognitive, effective and social outcomes. 

Cognitive outcomes. Measures in this domain assess characteristics 
purportedly measured by traditional tests of mental ability, aptitude and 
knowledge. The differentiating characteristic between ICA*s measures and 
traditional tests is that ICA*s measures are based on the idea that the test- 
taker should provide all the information necessary for adequate and appro- 
priate response to a problem on a test, as opposed to merely selecting from a 
set of prepared alternative responses. 

Effective outcomes. Variables measured in this domain are directly 
translatable to behavior patterns required beyond the world of academia. 
This category is derived from White's (1959) term "effectance,'* which means 
positive, goal-directed and productive interaction with and influence on the 
environment. 

Social outcomes. These measures assess areas of interpersonal compe- 
tence which often facilitate the fruition of cognitive and effective dimensions 
of competence in life. They take into consideration the attitudes, values and 
orientations toward others which moderate life goals and the means for 
achieving them. 

Measures of Cognitive Outcorhes 

1. Critical Thinking. The ability to analyze new information and to 
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synthesize new concepts based on this information reflects the ability to inte- 
grate information iiito one's own cognitive structure. As the cognitive struc- 
ture grows, so does the ability to think critically, to make a cogent argument 
and to reason inductively; thus, the test of Thematic Analysis is a measure of 
cognitive development. The test takes the form of two sets of stories which 
an individual is asked to compare themaiically. This **thematic analysis" is 
scored according to twelve categories of critical thinking and a total score is 
derived. This scoring system is reliable, efficient and cost-effective. Each 
scoring category is a logical and independent dimension of critical thinking 
skill. 

This test, developed by Winter (1973), is distinguished from other 
measures of critical thinking skills in that it demands the test-taker to actually 
produce critical arguments, rather than to simply recognize the critical ele- 
ments of arguments presented to him. This instrument can bt used to chart a 
student's progress in learning this skill. Alternative versions of the test have 
been developed to assess both the quality and structure of critical thinking. 

Recent studies undertaken to assess the effects of the college experi- 
ence upon undergraduates at Wesleyan and Harvard Universities (McQelland, 
1976) show that seniors score higher than freshmen on this measure. It is 
important to note in this context that many so-called "cognitive" tests do not 
reflect the improvement in students' skill over the course of a four-year col- 
lege experience. When one examines firsthand the responses to the test of 
Thematic Analysis, however, it is not only clear that critical thinking skills 
improve with college, but that the scoring system for this test is intuitively 
satisfying in the ground it covers. 

Under an ICA contract with The Fund for the Improvement of Post- 
secondary Education, Alvemo College began to administer the test of 
Thematic Analysis to incoming freshmen along with other measures, includ- 
ing the Watson-Glaser test of critical thinb'ng. A chief difference between 
Winter's measure and the Watson-Glaser is that the latter instrument only 
requires students to recognize critical thinking (a respondent measure), while 
the test of Thematic Analysis requires students to demonstrate critical think- 
ing ability (an operant measure). An analysis of the data showed that t^ie 
Watson-Glaser and Winter's measure of critical thinking were somewhat 
conelated, but only the test of Thematic Analysis was uncorrelated with 
respondent measures of other unrelated abilities. Those results speak favor- 
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ably for Wnter's measure as an u neon tamin ate d test of critical thinking 
skiU. 



2. Learning Styles. A successful worker is distinguished not so much 
by a single set of knowledge or skills, but by the ability to adapt to and 
master the changing demands of one's job and career: that is, his ability to 
learn. Continuing success in a changing world requires an ability to explore 
new opportunities and learn from past successes and failures. Kolb's Learn- 
ing Styles Inventory (1971) is a measure of individual learning styles which 
affect decision-making and problem-solving. The four styles. Concrete Experi- 
ential learning (CE), Reflective Observation learning (RO), Abstract Concept- 
ualization learning (AC), and Active Experimentation learning (AE), when 
present in equal proportions, indicate the type of persr;n who is able to in- 
volve himself fully, openly, and without bias in a new experience (CE), can 
reflect on and observe these experiences from many perspectives (RO), is 
able to create concepts that integrate his observations into logically sound 
"theories" (AC) and can use these theories to make decisions and solve 
problems (AE) (Kolb, 1973). 

Extensive data has been collected on this measure in both college and 
postacademic settings (particularly the world of business). Kolb and Goldman 
(1973) have documented the utility of the Learning Styles Inventory for 
predicting major areas of undergraduate specialization and graduate school 
plans among M.I.T. undergraduates. The better the match between a student's 
learning style and the major subject area of the student's choice, the greater 
the tendency for students to place high importance in pursuing a career in 
that area, to perceive their workload as light, and to involve themselves with 
important peer groups, and the lesser the tendency for students to experience 
disaffection with their social and academic experience. 

More recent work involving the analysis of administrative snd technical 
support positions in the Division of Civil Service, Commonwealth of Massa- 
chusetts, identified "the ability to learn fiom experience" as a key to worker 
success. The Concrete Experience (CE) scale of the Learning Styles Inventory 
was found, in fact, to be significantly correlated with superior performance 
in this category of work, involving over 15 job titles (Klemp, 1976). 

3. Programmed Cases, Based on incidents called from in-depth 
interviews with criterion groups, programmed cases can be developed to test 
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for social learning and judgment. Versions of this technique, developed for 
the U.S. Information Agency and the U.S. Navy, consist of a series of inci- 
dents to which several alternative responses are attached. All of the incidents 
pertain to a particular individual, or "case," "Distractors," or the incorrect 
responses, are developed with the aid of expert judges. The cases are pro- 
grammed in such a way that a person with good judgment, i.e., who does not 
make snap, impulsive judgments, will become more accurate in his choices 
of the correct alternative as he proceeds through the case. 

The programmed case technology has two primary uses: 

— diagnostic assessment of how one uses information in making 
decisions about others or predicting their behaviors, and 

— examination of the process by which decisions/predictions are 
made, including the analysis of values, biases and preconcep- 
tions that interfere with veridical impressions of others and their 
situations. 

These programmed cases are currently being used in psychological 
studies at Harvard as a measure of interpersonal learning. McBer's research 
interest in this technology has led to applications of programmed cases in the 
study of prejudice. 

Klemp (1975) found that people who were exposed to cases about 
people whose race was unlike tliat of the reader were less able to predict the 
behavior of the person in the case than readers who were exposed to same 
race cases. Similar studies are planned to address the prejudicial effects of 
socioeconomic status and sex differences on interpersonal learning. 

Tne direct application of programmed cases, other than personnel 
selection, has been in assessing the skills of human relations experts in the 
U.S. Navy. In a pilot study (unpublished) involving selected humaii resource 
training personnel whose performance level was known, a highly significant 
relationship obtained between the ability to accurately predict behavior in 
others, as measured by the programmed cases, and performance as a trainer 
in huiVian resource management. 

Other measures of cognitive outcomes, in prototype form, are the 
following: ^ ^ 
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4. Analysis of Argument. A test of the ability to argue for Gnd 
against a controversial issue, and scored for the logical presentation of argu- 
ment (Stewart, 1974). 

5. Concept Formation. A test of the abUity to identify and organize 
siinilarities and differences among objects into concepts. 

6. Speed of Learning. A test of how quickly one can learn new 
material selectively-that is, to remember functionally important informa- 
tion. 

7. Savings Score. A test of the ability to learn new material in a 
particular content area-to "save" new information in an area in which the 
student is already well versed. 

8. Proactive Case Response. A test of diagnosis, judgment, and 
problem solving that involves response to a detailed situation, or "case.". 

Measures of Effective Outcomes 

1. Diagnostic Listening. The Diagnostic Listening Test consists of a 
taped presentation, v/ith slides, of interviews with various individuals typical 
of the people one might encounter in social service work. People who take 
this test listen to an interview or a brief statement by a particular iiidividual 
on the tape, and are tl^xen asked some questions about what has happened, 
^ what the person is adiy like, and what they would recommend for the 
person. This test requires listening, observing and judging skills which have 
been found necessary in human service work. 

There are two subscales in this test. Tlie Casework Subscale, consisting 
of 42 itemr, is made up of four iv terviews and after each of them the person 
taking the test is asked to answer questions and to make judgments on a 
multiple-choice answer sheet. The Positive Bias Subscale, consisting of 39 
items, sho\ys tp test-takers three slides of clients of different sex and race 
with accompanying brief monologue. After each of these presentations, the 
test-takers are required to rate several adjectives as "does describe" or "does 
not describe" the client. An overall Positive Bias score is obtained by 
summing the number of positive yet realistic adjectives chosen. The Diag- 
nostic Listening test measures faith; the client's ability to change, ability 
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to observe and diagnose human problems, ability to set realistic goals, and 
ability to propose imaginative solutions. 

Studies of human service workers in the State of Massachusetts have 
verified the usefulness of the skills tapped by tlie Diagnostic Listening Test in 
identifying better workers. The format of the test instrument is similar to 
interview situations in which workers are involved on a day-to-day basis. Both 
of the two subscales correlate with effective on-the-job performance as rated 
by supervisory consensus (McCleUand and Klemp, 1974). 

Introduction to Measures 2 and 3: Much research has bssn accumulated 
by McCleUand (1958, 1961), McCleUand and Winter (1971), Atkinson 
(1958), and others that shows that thought patterns are related to important 
kinds of behaviors. The Exercise of Imagination is McBer's version of the 
Thematic Apperception Test (TAT) which is used to elicit thought patterns 
of the test-taker. 

An individual taking the test is asked to write narratives to pictures. 
Each of these narratives addresses the following questions about the pictures: 
What is happening? Who are the people? What has happened in the past that 
has led to the situation? WTiat is being thought? What is wanted by whom? 
What will happen? and What will be done? The stories are then scored, ac- 
cording to a prescribed set. of codes or rules, to uncover certain patterns of 
thought that are expressed in the stories. These scoring codes can be applied 
to any written narrative which addresses the types of questions mentioned 
above. 

" The link between thoughts and behavior has been repeatedly demon- 
strated to be strong, as opposed to the Unk between attitudes and behavior. 
The attitude-behavior link is influenced primarily by situational factors. An 
attitude may represent a specific goal or objective, but such goals and ob- 
jectives may change according to situational demands and constraints. How- 
ever, whether a specific goal ch?Jiges or not, the characteristic style with 
which any goal is attained is determined to a large extent by thought patterns 
which are relatively consistent within individuals. 

2. Achievement Motivation. McClelland has shown in extensive 
research (1961) that people high in the need for achievement are practical 
and interested in efficiency-in short, they are good practical decion-makers. 
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They are independent, good at evaluating information for its practical utility, 
and original in the sense that they keep looking for better ways of doing 
things. For instance, they maky good career decisions and regularly achieve 
greater success earlier in their careers. In a recent Harvard University longi- 
tudinal follow-up study, freshmen n Ach (need for achievement) scores 
correlated with "early success" in various fields 14 years later (McQelland, 
1976). 

In the world of business, studies have shown that achievement motiva- 
tion is highly related to small business success, success in sales, and perform- 
ance in the role of entrepreneur (McClelland and Bumham, 1976). The need 
for achievement, the desire to do things better than anyone else, is parti- 
cularly great among scientists and others who work against a self-imposed 
standard of excellence. People low in achievement motivation generally do^- 
not exhibit planning or goal-setting behavior, nor do they weigh the risks they 
take against expected gain. The habits of behavior in such persons may not 
be advantageous to success in school or in many kinds of careers. But McClel- 
land (1965) has pointed out that people can be taught tc behave in ways that 
arc reflected by the achievement motive, and so the gap between successful 
performance in certain academic and work settings may be effectively 
bridged. 

3. Self'Definition/Cognitive Initiative. Self-definition/cognitive in- 
itiative is a -general characteristic of an individual which encompasses the way 
one thinks about the world and himself, the way one reacts to new informa- 
tion, and the way one behaves. People with this competency are not only 
able to think clearly, but also to reason from the problem at hand to a solu- 
tion, and to propose and take effective action on their own. Such competence 
is characteristic of people who think in a rational, systematic way on their 
own, and who can anticipate problems before they arise. In short, it might 
be said that people who are high in this characteristic are able on their own to 
, see things clearly, to understand the causes of events, to reason from problem 
to solution, and to take effective action to solve problems. For example, the 
self-definition score has been quite useful in distinguishing between women 
who pursue careers following college and those who do not (Stewart and 
Winter, 1974). 

A longitudinal study involving freshmen women at Alvemo College 
begun by McBer with FIPSE funds, will track Self-Definition/Cognitivc 
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Initiative during the four-year college experience. The preUminary data on 
this measure show that it is uncorrected with other measures of college- 
entry knowledge, skills, and abilities. It is therefore considered to measure a 
Unique dime.Ci >jon that, because of its known predictive validity regarding the 
success i>i / : men in careers, is a particularly important measure in a 
competency f i sed assessment systom. 

Other measures of effective outcomes, in prototype form, are the fol- 
lowing: 

4. Socialized Power. A measure of whether a person is motivated to 
express or increase his own power for the good of the self or for the good of 
others. 

5. Stage IV Power, A recently identified measure (McClelland, 
1975) of a concern for doing one's duty, that is, to be an instrument of a 
power which extends beyond the self. 

Measures of Social Out'^:^.ines 

1, Nonverbal Sensitivity, This test, developed by Rosenthal and his 
associates at Harvard University (1974), consists of 40 brief voice segments 
on tape, all of which have been altered to obscure the words. There are two 
subscales to the test: the RS Subscale, made up of voice segments that are 
randomly spUced and reassembled, and the CF Subscale, made up of seg- 
ments which have been electronically filtered so that the words are unintelli- 
gible, but the intonation patterns remain. A sample item would consist of a 
speech segment followed by a question; e.g., "Does the segment represent 
someone helping a customer or criticizing someone else for being late?" 
Rosenthal has documented some promisng criterion validity for the PONS 
test. High scorers on this test exhibit the following characteristics: 

— they represent warmer, more hoiiest and more satisfying peer 
relationships; 

— they have been rated by peers and/or by teachers who know them 
well as being generally more sensitive in interpersonal situations; 
and 
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— they were found to be functioning more effectively in the social 
and intellectual areas of the California Personality Inventory. 

This test, which requires less tlian 10 minutes to administer, has been 
found to predict successful performajicc in administrative and human service 
jobs, which require that the worker have "empathy," or the "ability to read 
between the lines" in the performance of the job (Klemp, 1976). Navy per- 
sonnel involved in race relations v/ork also have been found to score higher 
than the general population on this test, and the personnel who are more 
successful on the job also score higher than their less successful counter- 
' parts. 



2. Moral Reasoning. This test is based on the research in moral 
development by Lawrence Kohlberg at Harvard (1970). The test consists of a 
series of paragraphs which describe complex situations in which the actors 
are forced to choose among several moral courses of action. The task of the 
applicant is to write a paragraph to justify the alternative that the applicant 
feels is the best one on moral grounds. The essay answers are scored accord- 
ing to a thematic analysis developed by Kohlberg, and are interpreted accord- 
ing to a schema containing six levels of moral development: 

Stage 1: Orientation to obedience and punishment— deference to a 
superior power or to trouble-avoidance. 

Stage 2: Orientation to action that is satisfying to the needs of the 
self. 

Stage 3: Orientation toward approval and to pleasing and helping 
others. 



Stage 4: Authority and social order maintenance orientation— 
"doing duty" and showing respect for authority. 

Stage 5: Orientation to duty defined in terms of a contract, general 
avoidance of violation of the rights of others, and majority 
will and welfare. 



Stage 6: Orientation to high principle or conscience. 
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The conceptual categories on which the test is based have a high degree of 
validity as constructs. 

Some recent work in the medical profession has related Kohlberg's 
work to the practice of physicians. High relationships exist between a physi- 
cian's level of moral development and whether he will withhold or pursue 
treatment, the degree to which he considers the patient in the context of his 
family, and overall ratings of physician performance. These results show the 
Moral Reasoning Test to be predictive of important kinds of behavior in work 
which requires a good deal of value judgment. As the study of one's own 
values is becoming n part of what many competency-based programs wish to 
offer their students, Kohlberg's stage orientation to moral development is 
off^jicd as an important component to this educational experience. 

Other measures of social outcomes, in prototype form, are the follow- 
ing: 

3. Affiliation Motivation. A measure that reflects one's concern 
for the compassionate quality of relationships, helpful in building good work- 
ing associations with friends and colleagues. 

4. Social'Emotiona! Maturity. A scoring system of written nar- 
rative buOt upon a stage theory of maturity (Stewart, 1973) that makes sense 
both theoretically and intuitively. Table 1 presents a summary of this section. 



A General Integrative Model 

Of the tests and measures outlined in the preceding section, none is 
especially useful as a diagnostic or assessment tool outside of a systerp^itic 
approach to understanding the integration of the man/skills that are required 
for success in life and work. The measures may be important piecei to the 
puzzle, but one cannot tell from pieces alone what the whole indivic'ual will 
look like. From the standpoint of competency-based education, it is the 
meaningful integration of life skills that is important as an outcome of the 
educational experience. The General Integrative Model is one way of express- 
ing this value by involving several different measures in a system that can be 
used to assess student competence. 
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Table 1 

Competency Based Measures and Their Developmental Status 



.S .S I 



Cognitive 

1. Critical Thinking X X 

2. Learning Styles XXX 

3. Programmed Cases X X 

4. Analysis of Argument X X 

5. Concept Formation X 

6. Speed of Learning X X 

7. Savings Score X 
9 . Proactive Case Response X 

Effective 

1. Diagnostic Listening • X X X 

2. Achievement Motivation XX X 

3. Self-Definition/Cognitive Initiative XXX 

4. Socialized Power X X 

5. Stage IV Power X 



Social 



1. 


Nonverbal Sensitivity 


X 


X 


X 


2. 


Moral Reasoning 


X 


X 


X 


3. 


Affiliation Motivation 


X 




X 


4. 


Social-Emotional Maturity 


X 


X 
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Such general competencies as the ability to cope with new problems, to 
find appropriate solutions, and to take the correct action steps can be con- 
sidered in such a model. Figure 5 dutUnes one approximation to a systems 
approach that involves an integrated set of measures in a particular problem 
area, allows assessment at various junctures in the system for diagnostic 
purposes, and that also ser/es as a model for learning new skills throu^ feed- 
back in one's own performance. This particular version of the General Inte- 
grative Model requires an individual to demonstrate the following abilities: 

— to observe ; 

— to extract relevant information; 

— to analyze and integrate this information; 

— to ask appropriate questions; 

— to process new information in response to such questions; 

— to utilize this information and one's knowledge in inakinj^ sound 
and logical recommendations; 

— to develop main and contingency plans; 

— to set meaningful goals; and 

— to feed back this new information mto the process for better 
problem analysis and solutions. 

This model is not a measure per se, but a collection of measures logi- 
cally ordered, to assess problem solving skills- The progress from stage to 
stage in the model presents the students with subproblems to solve, e.g., what 
new information to seek, what conclusions to draw, and what decisions to 
make derived from the information gathered at a given time. 

This particular model emphasizes cognitive skills, but other models can 
be developed that deal in different areas of competence. For example, the 
U.S. Navy, in their JHuman Goals Program, is striving to implement a train- 
ing model that uses as input tests of achievement, affiliation, and power, 
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SLT = speed of Learn- 
ing Test 

PCRT = Pro-active Case 
Response Test 

SST = Savings Score 
test 



Notes: (1) Applicable 
Tests are noted in 
parentheses at or 
between stages of 
the model. (2) ♦ 
Designates responses 
by the person 
being evaluated. 



Present new 
material 



1 



Extract infor- 
mation—make 
recommendations 

Ask Questions* - 
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programmed cases, learning styles, and sensitivity to nonverbal communica- 
tion. By using this model, the Navy seeks not only to assess and diagnose, but 
to develop curriculum aimed at more effective preparation of their personnel 
for work. 



Characteristics and Advantages of 
Competency-Based Measures 

This section pertains particularly to the measures outlined above, but 
may also be considered to be the hallmark attributes of competency-based 
measurement in general. 

1. These tests require the person being tested to be proactive, not 
just reactive (i.e., one has to generate responses which can be scored for their 
appropriateness to real life situations). Thus, the test-taker goes beyond 
recognizing answers out of context. In the general model, if timing of ques- 
tions or recommendations is a critical aspect of problem-solving, then this 
time variable can be programmed into the model as well. 

2. The tests are efficient since they can be given to groups as well as 
to individuals. Their efficiency and economy should substantially reduce the 
operational costs of current assessment procedures which require vast 
amounts of time, people and other resources. 

3. These instruments foster equity in the assessment process, since 
they can be objectively and reliably scored according to the empirically 
validated coding systems. This is an important advantage since current 
methods of using juries, panels, or other groups to evaluate are not only 
inefficient and uneconomical, but are also vulnerable to all the vagaries of 
subjectivism, 

4. The scores can be standardized with reference to criterion groups 
of which a student is preparing to become a part. 

5. Many of these tests tap the competency of "learning how to 
learn" in a content area. This is, one of the most important competencies 
people can develop because througliout their lives they will be faced with the 
problem of learning new things in selected areas. 
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6. These tests are much less threatening and anxiety-producing than 
traditional tests of recall or recognition, which because of their properties 
only contribute to the fear of failure so prominent in non traditional students. 

7. A number of variations of these tests and the General Mod?l can 
be developed to add flexibility for administrators, e.^., they lend themselves 
to video taping, written or oral answers, individual or gioup testing, etc. 

8. The majority of these tests have face validity. Educators and stu^ 
dents recognize that the skills and abilities being demonstrated are appli- 
cable to general hfe skills. 

9. Empirical and construct validation with various occupational and 
life skills outside of academia means that the competencies required for suc- 
cessful performance beyond the academic program can be established as the 
target of the learning process. 

10. The models and tests can be validated with a variety of nonoccu- 
pation-specific populations. Some tests and models developed are noncontent 
-specific such that a competent person with little formal education can 
demonstrate competence as an analytic thinker^ information processor, and 
a proactive initiator of appropriate solutions. The test format is easily 
followed and is attractive to those who are test-anxious in traditional test 
settings. 

11. These measures can serve as pedagogical devices as well as assess- 
ment instruments, since practice in dealing with the information and com- 
ponent competencies necessary to solve the test problems is a direct way of 
learning. The instructor and student alike can easily locate and analyze weak- 
nesses and strengths of an individual in exercising component skills. Thus, 
these measures can serve as diagnostic and guidance tools for supplementary 
curricular modules. 

12. One need not take a particular course or go to a particular college 
in order to attain competence in the generic skills and abOities measured by 
these assessment tools. 
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APPENDIX A 



BRIEF GUIDELINES FOR TEST DEVELOPMENT AND UTILIZATION 
(From Pottinger and Klemp, 1976) 

These guidelines are partially based upon three aspects of assessment 
which have been addressed elsewhere by Pottinger (1975): 

— The identification and definition of competencies relevant to 
life and work outside of academia; 

— Instrumentation, techniques, and processes of evaluation that 
provide reliable and valid measures of these competencies; and 

— Standardization, and/or establishment of levels of performance 
necessary and sufficient for awarding credentials. 

A. "New" competencies must be identified and operationally defined. 
There are many outcomes of the learning experience that have greater 

validity than grades in school as a basis for awarding credentials. Those that 
have been identified have been accepted as being important and meaningful 
in establishing a person's competence, yet many academicians have not 
sought to operationalize, measure, and award credit for many of these learn- 
ing outcomes. There are many other criteria than traditionally-rewarded 
scholastic achievement ihat are important as competencies in the practical 
work, and most of them are as yet unidentified. 

B. New competencies should have general significance to a wide variety 
of career and life outcomes. 

Competencies cannot be meaningfully defined by a seemingly endless 
reduction of specific skills, tasks and actions which ultimately fall short of 
real-world requirement for effective perfomnance. In fact, the more essential 
characteristics for success often turn out to be broad or generalized abilities 
or characteristics which are sometimes more easily operationally defined and 
measured than an array of specific "subskills** which do not add up to general 
competence. 

C. New definition of competencies and measures developed for their as- 
sessment should be easy for faculty and students to understand and use. 
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Nr;w competency definitions should be readily recognizable as import- 
ant, and related assessment techniques and instruments should be easy for 
faculty and students to understand. It is necessary to guard against compe- 
tency definitions and measures that are so complex, or trivial, or esoteric 
that students and faculty can neither understand them, nor accept them as 
meaningful and useful. In other words, educational goals should not be ren- 
dered unintelligible, and assessment procedures and instruments should not 
mystify the process of evaluating students' progress. 

D. Competencies should be empirically linked to extemal realities. 

Many educators assume that such things as the ability to master new . 
bodies of knowledge quickly and effectively, to analyze and solve problems, 
to develop new sloils efficiently, aiid to utilize knowledge are prerequisites 
for individuals if they are to take advantage of life's opportunities and sur- 
mount its difficulties. What is missing are the Treasures of these general 
abilities, which are related to ?jnportant life outcomes. Only when we know 
what makes the difference between adequate and inadequate performance, 
based on empirical analyses of professions and other Ufe activities, will we be 
able to develop or improve such measures, clarify new competencies, and 
establish credentials of demonstrated value. ' 

E. The discovery of new ways of measuring abilities (competencies) is 
needed. 

The measurement technology must be innova;lve and new^ not just a 
new name for traditional procedures. Paper-and-pencil (objective) tests, due 
to method variance, correlate better with each other than they do with 
performance criteria. If postsecondary education is to break out of this closed 
circuit, different approaches to testing must be sought in areas such as learn- 
ing, critical thinking, problem solving and other newly defined competencies. 
Measures of competence must require that the test tskei generate appropriate 
learning outcome responses. The primary learning objective of education is 
not to help an individual select from among a set of predetermined alter- 
natives. Rather, it is to enable a person to know how to reason; how to 
marshal evidence for or against an hypothesis; how to see similarities and 
differences in objects, ideas, and events; how to partial out cnicial informa- 
tion from the trivial; and how to integrate these skills with purpose and 
meaning. Multiple-choice tests do not and cannot measure these abilities. And 
the behavioral observation/documentation approaches that are popular in 
experiential learning assessment do not allow these abilities to be measured 
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with adequate reliability or validiiy. 

F. Standards of performance for awarding credentials should acknowledge 
levels of performance required for entry into roles outside of academic 
settings. 

The establishment of ci eria or standards of competence is one of the 
most difficult problems to be addressed. In every case, where standards of 
competence are determined for new or for more traditional outcomes, appro- 
priate levels should be established by sufficient empirical evidence to ensure 
that they will not be viewed as arbitrary. Many educators are satisfied with 
a priori judgments of what skills and levels of performance are adequate. It 
is startling to reahze how mnch we accept the face validity of credentials and 
how little we really know about (1) the conespondence between the abilities 
and levels of performance that these credentials represent, and (2) what is 
needed for adequate performance in life's tasks. We need to develop better 
benchmarks for evaluating the standards and the offerings of postsecondary 
institutions. (For further comments about the establishment of standards 
and levels of performance, see Appendix C.^^ 

G. New attempts to define and assess learning outcomes should not be 
guided solely by attempts to make them functionally-equivalent substi- 
tutes for traditionally assessed school achievement. 
Competency-based education requires a. different type of evaluation 

from traditional programs to the extent that learning ou;r:omes differ in 
significant ways. For example, learning outcomes in CBE are often defined in 
terms of what a person can do, not merely in terms of what one knows. 
Furthermore, 

whereas in traditional programs evaluation is primarily linked 
to the credentialing process, in competency programs it is also 
used as a formative teaching tool. In other words, students are 
made aware of the criteria and standards for certificatia*: in a 
competency, and JJieir progress is frequently measured oo that 
help can be provided as necessary. Assessment that simply places 
students in a peicentUe < t just discriminates between passing and 
failmg is not adequate for competency-based programs. Forma- 
tive diagnostic advice is needed-information that tells if the stu- 
dent is ''real world** competent (Hodgkinson, 1975). 
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The temptation to restrict the development of new measurement 
instruments, techniques, and procedures, in order to achieve comparability 
with those that have gone before, has great political appeal for making such 
innovations palatable to traditionalists. However, if institutional and creden- 
tial reforms are to succeed, we need to move beyond the recognized limita- 
tions of traditional assessment systems. 
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APPENDIX B 



DETERMINING THE MEANING OF MEASURES 



As background to this discussion, we have already stressed the import- 
ance of, for example, changing the focus of assessment from merely asking 
for recall and recognition of content to measuring how one processes and 
utilizes this information. If assessment tecliniques are to have sufficient mean- 
ing and credibility for determining if students are adequately prepared for 
teaching, we can no longer be satisfied with content-vaUd tests. Construct 
validation must be determined. Furthermore, PBTE proponents have stressed 
the importance of creating criterion-referenced measures which are predictive 
or reflective of real world requirements for successful teaching. Ihe follow- 
ing d[iscussion (Pottinger and Klemp, 1976) is a further elaboration on the 
necessity for construct validation and empirical linkage of measures to obtain 
maximum meaning of what is being assessed. 

Messick (1975) has argued that, until measures have been construct 
validated, they lack the meaning essential to utilizing them as instruments of 
general education theory. McQelland (1973) further argues that, until con- 
struct vahdated measures use relevant real world events among their criterion 
referents, their value in assessing preparedness for work and life is limited. 
Educators have often failed to pay attention to construct validity because 
they "view desired behaviors as ends in themselves with little concern for the 
processes that produce them or for the causes of the undesired behaviors to 
be rectified" (Messick, p. 959). In other words, "construct validity is not 
usually sought for educational tests, because they are typically already con- 
sidered to be valid on oth.:/ grounds, namely, on the grounds of content 
validity" (Messick, p. 959). 

In short, educators have traditionally been satisfied with knowing that 
the content of tests adequately sample a class of situations or subject matter. 
Messick (1975) argues that content validity does not provide an evidential 
basis for interpreting the meaning of test scores, and McClelland (1973) 
argues further that the interpreted meaning of scores that come from con- 
struct validation must be strengthened by tying these constructs directly \0 
the world of events outside of academia. 
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The theoreiiccl distinction between general education and competency- 
based education is that the latter requires an empirical and <:ausal link be- 
tween measurement responses and their m^anin?', as related to real world life 
outcomes. Most competency-based progra.ns, however, merely correlate test 
responses with specific criterion-referenced outcomes (and many do not even 
do this) without discovering the underlying causes of these responses. Many 
educators make the mistake of thinking that if a test correlates with a behav- 
ioral criterion variable in the world of work or elsewhere outside of the aca- 
demic world, one can develop competence by **teaching to the test." But this 
notion confuses correlation with causation, i.e., the fact that tests correlate 
with observable criteria may only indicate the existence of a causal inter- 
vening variable which is really responsible for behavior and which has not 
been measured.^ 

Qearly the mandate for competency^based postsecondary education is 
to identify skills and abilities that produce (cause) desired outcomes; to 
develop curricula aimed at the acquisition of these skills and abilities; and to 
design and validate measures that are sensitive to the acquisition processes 
and are representative of the criterion outcomes. One should not consider 
curriculum development apart from assessment issues and neither should be 
considered in the absence of ideiitified valid performance criteria. Only when 
these conditions are satisfied does it make sense to "teach to the test." 

The skills tapped by genuine competency^based tests (i.e., causally- 
related criterion measures) are largely independent of the content areaf in 
which they are used. For example, the tests for thematic analysis, analysis 
of argument, problem solving, speed of learning, and other such measures 
described in the text test for generic abilities (competencies) which can be 
demonstrated in the context of any specific content area. These tests can be 
adapted to the natural sciences, social sciences, and humanities with equal 
facility; the content area does not determine the effectiveness of the test. We 



For example, vocabulary is correlated with college grades. However, one would 
not go about improving college grades merely by increasing vocabulary. Doing well in 
school requires abilities for problem solving, utilizing new information, aud other skills 
not measured by vocabulary tests. Vocabulary is merely a tool, and how it is used de- 
pends upon, other abilities and characteristics of the individual. One cannot do well in 
school without a reasonably adequate vocabulary, b.ut having a strong vocabulary will 
not guarantee success in school without its effective use. 
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will always need tests of knowledge, but we also need tests of the way this 
knowledge is used. The measures discussed m the third section satisfy both of 
these criteria, which represent the essence of competency-based assessment. 

A criticism leveled at the PBTE movement is that it is limited to pre- 
paration of **didactical technicians" (Broudy, 1972). A nanow correlational 
model of competence has fostered this notion, and this concern is legitimate 
to the extent that criterion validities depend exclusively upon specific task- 
oriented behavioral criterion references. Such validities for teacher education 
"are of sporadic interpretive utility" at best since they ignore the linking of 
test behavior to a more general attribute, process, or trait which provides an 
evidential basis for interpreting the processes underlying test scores. (Messick, 
1975) 

ICA strongly endorses this position but adds that construct validation is 
itself all too often limited in the types of referents it uses to provide meaning 
to test scores. Thus, we advocate a validation model that draws from the 
strengths of construct validation more heavily in the context of real world 
events or life outcomes than in the context of other constructs alone or 
"laboratory" behaviors. While Messick (1975) de-emphasizes criterriiJ-refer- 
encing, he only does so (1) in terms of using criterion-referents outside of the 
context of construct validation and (2) perhaps in termo of the type of cri- 
terion used as referents. Indeed, all validation's criterion-referenced. The 
difference in criteria (e.g., "real world" performance, other tests, or observa- 
ble "laboratory" behavior) determines tlie extent to which the meaning of 
the test responses are general or specific and of theoretical or real world signi- 
ficance. A difference between McGlelland's (1973) and Messick's point of 
view is McOelland's emphasis on choosing real world behaviors as opposed to 
tests (which typically tap respondent rather than operant behaviors) and 
laboratory behaviors, as criterion referents. Thus, cjiterion-refcrents consti- 
tuted by a nomological network of life outcomes are consistent with 
Messick's argument. Espousing such referents differs from Messick's point of 
view only in terms of emphasizing their selection as criteria for construct 
validation, not in the validation procedures or concepts tliemselves. In other 
words, Messick's notion of construct validation theoretically would include 
criterion behaviors, but empirically there are differences in emphasis on the 
types of behaviors to be included. It is for the sake of this difference in 
emphasis, not theoretical differences, that we have isolated real world events 
or life outcomes as critical factors in determining the real meaning of tests. 
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The strength and future of PBTE rests on its ability to support the 
rigorous type of research analysis which involves construct validation based 
heavily upon real world teaching outcomes. Until we have identified the criti- 
cal intervening variables in the causal chain between the educational experi- 
ence and performance in the field, we will be legitimately faulted by critics 
who view PBTE assessment (and education) as too nanow in scope. 
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APPENDIX C 



THE PROBLEM OF ESTABLISHING CRITERION LEVELS 
OR PERFORMANCE STANDARDS 



As the meaning of measures becomes established by construct-valida- 
tion and empirical (criterion-referenced) links between education and the 
requirements of postacademic life, the question of what criterion levels of 
performance are necessary for granting credentials is made easier, perhaps, 
because concrete information exists with which educators can make sound 
judgments. Yet, the problem of establish, .g standards for levels of perform- 
ance is a complex one because (1) this determination of appropriate levels of 
performance is dependent upon educators' goals for credentiali^ig ftv:dents, 
and (2) technical issues related to understanding the meaning of maximum 
levels of performance and the meaning of complex interaction of abilities 
probably necessitate highly subjective determinations of criterion standards. 

Witli regard to the first point about determining standards of perform- 
ance, Hodgkinson (1975) stresses the importance of asking good questions 
about the use and purposes of assessment. Sound judgment and planning are 
necessary to avoid proceeding with evaluative decisions based on ambiguous 
criteria, standards and/or levels of outcomes. These questions must include: 
Who establishes criteria or standards- 3n external auditing agency, a faculty 
member, the institution? What is the reference group with which one will be 
compared—peTfoirneTS in tlie real world, students in past years, other students 
currently being evaluated, one*s own past performance, an ideal student? 
Wt:at is the proper method of comparison?- norm-re feienced tests, criterion- 
referenced iests, behavioral measures, narratives (e.g., f>ortfohos, diaries of 
past experience), unobtrusive measures, etc.? What is the nature of the stan- 
dard-job performance in the "real world,'* individual growth and develop- 
ment, ideological ideals of performance, standardized scores? What is the 
function of the standard- to select or reject people, to improve perform- 
ances, to admit students to professional schools, or jobs? 

If these questions are asked and the answers are concrete, specific and 
meaningful, a student should know who is judging him, how he will be 
judged, the nature of these judgments, the objectives related to them, and 
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how well he mrist perform to meet those objectives. 

With regard to the second point about determining standards of per- 
formance, two conceptual or technical considerations are also relevant. 

1. The Problem of Maximum Levels 

Credentials are often restricted to those whose scholastic performance 
and/or te.^.t scores are higher than minimal levels required for work or other 
social Such occunences discriminate unfairly against those who are 

competent to work, for example, but who are selected out of occupational 
opportunities by those who believe in the simple equation: higher academic 
achievement means better work or life performance. The tacit assumption 
that superior abilities in all measured characteristics are necessary or even 
desirable for performance is highly questionable.^ 

Measures typically used to assess job task performance and performance 
relating to the mastery of units in a curriculum typically have little bearing 
on how subunits interact. For any given job, Hfc task, or individual perform- 
ance, component -dcills in one area can compensate for deficiencies in others 
creating z variety of combinations of individual performance le els which 
could theoretically add up to equivalent overall performance. Thus, minimal 
levels of performance on individual variables (which compromise overall 
competence) may have Httle meaning by themselves. Their interactions with 
respect to outcomes may have far greater significance. 

We are most familiar with this problem in cognitive areas of education. 
We are often taught language use, verbal reasoning, spatial relationship, read- 
ing comprehension, abstract reasoning and syllogistic analysis (e.g., as 
measured by Miller Analogies) as discrete units of curricula. Assessment of 
integrated or general skills such as problem solving often do not take into 
account the interactive nature of skills in these subcomponent areas. Cogni- 
tive measures are used almost exclusively in assessment as if the qualities 



simple motor ^citf example will demonstrate this point: we know that an auto- 
mobile driver must grip the steering wheel with enough force to maintain control of the 
car. But beyond a certain level of pressure, added strength in holding the wheel does not 
increase overall driving competency. And this is just one of some 3,400 discrete behav- 
iors identified by researcheis as making up the task of "driving." 
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they measure did not interact, i.e., they rite tested separately. 

Tlie importance of interactions, while intuitively obvious in the motor 
skills area, have not been carefully attended to in cognitive and social/ 
emotional areas of assessment. Yet, once individuals have gone through a 
series of academic life experiences that enhance their competence in dealing 
with school, work, and other life experiences, the appropriate assessment 
task becomes that of measuring such integrated and generalized learning out- 
comes as the ability to cope with new problems, to find appropriate solu- 
tions, and te take correct actions. 

Measures which reflect the interdependent nature of cognitive skills 
essential for satisfactory functioning outside of academia have only begun 
to be developed.'' For example, Klemp's General Integrative Model of Assess- 
ment, incorporating a variety of independent techniques, is an approach to 
summative evaluation of an individual's abiUty to solve a problem which has 
as many elements,and complexities of xeal life situations as possible. Such an 
assessment of individuals has the potential of coming closer to tapping real 
life competence than can any single test alone. 

While it makes sense to require minimal levels of proficiency for many 
competencies, ability levels over and above necessary cut-off points do not 
always conelate with overall performance. 

For example, in a job analysis, McQelland and Dailey (1974) found 
that a minimal level of organizational or clerical competence was necessary 
for human service workers in the Massachusetts Civil Service system, but 
high scores on these measures were negatively correlated with superior fob 
performance. Selecting people by rank according to score not only discrimi- 
nated against those whose scores were adequate (sufficient) though "Uncom- 
petitive," but the process failed to select the better job performers as well. 
This finding and others^ suggest that going beyond sufficient levels of com- 



A recent example in the noncognitive area by McCelland and Bumham (1976) 
reports the importance of the interaction between levels of motivation and ego-maturity 
for managerial competence. 

o 

A recent study at Harvard revealed that tho past SAT scores of faculty members 
were negatively correlated with .Tiore successful teachers (McQelland, personal com- 
munication). 
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petency in award mg credentials cna be very dysfunctional for socieiy— not 
cniy in terms of equity, but in terms of meritocracy as well. 

In many job situations, where cognitive and other competency meas- 
ures are used to select job applicants, even if job re^ ivance of the character- 
istics being t, sted for can be demonstrated (e.g., 'Verbal ability" in human 
service v/ovkers), level of sufficiency for conipetent job performance is rarely 
evaluated or known. 

We need more empirical research to estahlish minimal levels of compe- 
tence required for quality performance based on how workers in the field 
perform on various competency measures. 

2. The Problem of Interactions 

Researchers have long recognized that the interaction effects of vari- 
ables are quite often more significant and meaningful than individual variables 
taken alone. It was stressed earlier that competence is not a simple summa- 
tion of discretely defmed skills and abilities. This is readily seen in the 
example of driving ability. Although one can identify many skills necessary 
for safe and effective driving— including attitudes, cognitive skills, and emo- 
tional factors, as well as perceptual and motor skills— it is intuitively obvious 
that a simple summation of measurement scores on these discrete task per- 
formances would not at4d up to equivalent driving skills. An individual who 
is overly competent at some driving skills but woefully inadequate at others 
would be a poorer driver than someone whose skills were all sufficient, 
though their summed skill scores would be identical. 

The implication for higher education is ?hat one cannot assume that 
abilities or skills discretely learned will be integrated in work and life func- 
tions and consequently that establishment of minimal levels of performance 
on isolated skills or "subcompetencies" have much meaning in themselves. 
Therefore, competency research, new assessment procedures, and test instru- 
ments must also focus on the interdependence of skills. 
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STATE INTEREST AND 



TEACHER EDUCATION PROGRAM APPROVAL 



By Lawrence D, Freeman 

Larr>' Freeman completed his Ph.D, in English in 1968 at the University 
of Nebraska-Lincoln. During his doctoral studies he worked at the Nebraska 
Curriculum Development Center on the *'Nebraska" Curriculum in English 
and' assisted in establishing and implementing the Tri-University Project. 
After teaching English at SUNY at Binghamton for two years. Freeman 
served as Co-director of the Nebraska Confederation for Early Childhood and 
then as Associate Director of the SCUEET. He is presently Director of 
Teacher Education Program Approval in the Illinois Office of Education. 

During his tenure at the Study Commission, Freeman focused much 
of his time and energy on examining the ways in which existing legal and 
quasi-legal structures may impede the development of better teacher educa- 
tion. In his present position, he continues his exploration in these areas. He 
is presently preparing a manuscript that extends the observations and argu- 
ments that he makes in the following essays. 
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The following papers are working papers presented to the State Teacher 
Certification Board of Illinois; they represent "staff thoughts" and do not 
necessarily reflect Illinois policy. 

GENERAL DESCRIPTION OF THE ACTIVITIES 
ASSOCIATED WITH REVIEWS OF 
INSTITUTIONS AND PROGRAMS 
******** 

CHARACTER AND USE OF EVIDENCE 
IN PROGRAM APPROVAL 
******** 

DUE PROCESS FOR INSTITUTIONS AND STUDENTS: 
IMPLICATIONS FOR PERIODIC REVIEWS 



98 



STATE INTEREST AND 
TEACHER EDUCATION PROGRAM APPROVAL 

By Lawrence D. Freeman 



At present, those administering state statutes regarding the certification 
of school personnel find themselves forced, or electing, to rely on highly 
generalized statements about an individual, on v/hat I will call a "summary 
account." States administer statutes that typically call for a stated degree 
comprising a certain number of semester hours, awarded by a certain kind of 
institution; in some cases, the distribution of some of the hours i^ specified 
in a general way. The summary accounts of an individual's preparation and 
past performance show up as transcripts. In the typicaJ case of a state statute 
regarding certification, two problems emerge: (1) credit hours range from 
meaningless to unreliable, and (2) it is increasingly difficult to jensibly dis- 
tinguish between "professional'* and "general" education, between "clinical 
experiences*' and "student teaching.'* As a result, state officials—while trying 
to pursue actions borne of common sense— almost inevitably end up adminis- 
tering a set of stipulative definitions borne of administrative necessity that 
have an increasingly questionable relationship to performance on the job. 
Consequently, state officials typically become like high priests who done 
have access to the arcane mysteries of certification. 

What appears to be missing in the typical state statute, and in the rules 
and regulations, is an explicit notion of what distinguishes a teacher from a 
non-teacher. Or put another way, there is no easily accessible explanation of 
why the state has sought to exercise its police power requiring certification in 
order to be employed as a teacher in the public schools. A partial explanation 
of this phenomenon may lie in the peculiar validity of the teaching license. 
Teaching is a spontaneous human activity whose origins can be traced into 
pre-history. Only since the middle of the nineteenth century have claims for 



Note: The views and opinions presented in this paper are those of the author. No 
inference should be made that they represent, in whole or in part, the official or unof- 
ficial views of the Illinois State Board of Education, the Illinois Office of Education, or 
the Illinois State Teacher Certification Board. 
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teaching as a "science," an art, or co mplicated set of skills been made. But 
the fact remains that the validity of a teaching license is restricted to a 
particular physical situation— the public schools. Outside of such situations, 
one can proclaim himself a "teacher" or engage in teaching without legal 
penalty. Unlike some professions and trades, the teaching profession has no 
enforceable definition of work and unlike, say, psychologists, the use of the 
title "teacher" needs no licensure. Thus, because the validity of licenses 
awarded school personnel is restricted to a physical setting and lo eligibility 
to be placed on a payroll, the tough questions regarding the characteristics of 
"teachers" as opposed to "non-teachers" have typically not been addressed in 
the creation and administration of the teacher certification statutes. 

We find ourselves, then, making distinctions between "teachers" and 
non-teachers on the basis of summary accounts such as transcripts. Tliese 
summary accounts find meaning as a result of a complex wel of stipulative 
definitions that in the view of some approach arbitrariness ant irrationality 
and which under tlie day-to-day pressures of issuing certificates become 
increasingly removed from the naturally articulated concerns of parents, 
citizens, and the teaching profession itself. 

Reliance on summary accounts will in all likelihood persist, if only for 
bureaucratic reasons. A system relying on more extensive, more detaUed, and 
consequently more meaningful accounts is necessarily more unwieldy, more 
vulnerable to attack, and more expensive. Such a system probably requires a 
collective decision -making process because virtually every case repre<;ents 
a novel situation, something that can be fairly easily avoided when relying on 
highly generalized accounts. 

We have come to rely on the credit hour, even thougli such reliance has 
been questioned almost since the use of credit hours became a widespread 
practice. The Carnegie Foundation for the Advancement of Teaching, a prime 
mover in developing and implementing the credit hour, began in the thirties 
to seek a replacement and expended considerable effort and money to 
develop the Graduate Record Examination. This whole effort might well be 
regarded as replacing one kind of summary account with another. In teacher - 
education, an analogous effort resulted in the National Teachers Examination 
which purports to provide a more detaUed accounting of an individual's 
acfiievements tlian a transcript. Similar claims are apparently made for tliose 
examinations used by jurisdictions such as Chicago and New York City. 
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Others at tliis conference will undoubtedly consider tlie validity of such 
claims and the relevance of these claims to awarding certificates. 

In summary, it appears that those who have made and continue to 
make decisions in the process of awarding certificates have sought strenu- 
ously to develop ways to make the use of general and summary accounts 
reliable bases for their decisions. In spite of these efforts, however, these 
accounts remain based on examination of bits and pieces of behavior, not on 
an examination of a totality of behavior or entire acts. And, at the end, one 
does not know to what the summary account attests. It may mean only a 
cooperative registrar. 

Tlierc arc issues that reach beyond tlie adequacy of summary accounts. 
For instance, whatever kind of accounts one wishes to rely on, there is the 
issue of the relevance of the account to the decision to be made. This, in 
short, is the question raised by equal employment legislation, Griggs and its 
progeny: Do the summar>^ accounts used as a basis for certificating meet any 
reasonable standards for admissability as evidence, and if they do, what 
kinds of inferences can legitimately be drawn from them, particularly infer- 
ences of a predictive character? 

What we may need is an idealization of the certification system. From 
my perspective, such an ideal system would minimally meet the following 
criteria: 

(1) The information and evidence considered would be sufficiently 
comprehensive and detailed that they provide a picture of the 
totality of an individual's competence and ability. Well-designed 
decision-making in regard to tenure might illustrate what I have 
in mind here. 

(2) The information is admitted for consideration on the basis of 
complying with a set of standards rationally related to the class 
of jobs the certificate makes one eligible for. 

(3) Inferences drawn from the information are rational, legitimate, 
and logical. Such inferences need not be validated by empirical 
evidence but have at least an aura of common sense. 

Transcript analysis fails on all three levels; exclusive or partial reliance 
on paper and pencil tests also fails. What then is to be done? 

91 



101 



At the present moment, a mandated system of institutional and pro- 
gram approval seems tlie best way to proceed. Personally, I believe program 
approval and issuing ceitificates by entitlement may be legally vulnerable. 1 
remain skeptical of ihe legal soundness of delegating certification responsibili- 
ties to public and private colleges and universities and of other features of 
the arrangement. But faced with tlie trade-offs, 1 am convinced that program 
approval represents the only process that minimizes the legal vulnerabilities 
and simultaneously has the potential for approximating the criteria I set forth 
above. Program approval, for instance, puts meaning behind transcripts and 
degrees and fixes the responsibility for assessing a candidate's total behavior 
at a level where such assessments can be made. 

Program approval, however, is not presently without its liabilities and 
vulnerabilities. Some of its liabilities can be traced to its historical reliance on 
the kinds of standards and technologies developed in the sphere of voluntar>' 
accreditation. Voluntary accreditation has always had a different set, or at 
least additional, objectives than state-mandated systems of approval. But 
program approval can also learn from recent developments in voluntary accre- 
ditation. For instance, the development of appeals processes in voluntary 
accreditation might be pursued. Such processes should, with care for preserv- 
ing due process, enable challenges by institutions, candidates for certificates, 
prospective employees, and consumers. 

Program approval, to realize its potential, must also be prevented from 
becoming merely transcript evaluation writ large. It must avoid the rigidities 
of such evaluation in order to facilitate institutions' quick response to chang- 
ing and emerging needs in the public schools. And of course program approval 
must be supported with sufficient resources that rigorous monitoring can 
occur. 

But most importantly, program approval systems, in order to do tlieir 
job, need to become public and adversarial in character, and they need to be 
based on some clear conception of the state interest that they purportedly 
protect. It is perhaps the lack of a conception of state interests to be pro- 
tected that renders present program approval systems suspect; and one might 
add that the recent . overcoming of the chronic shortage of teachers during the 
past few decades and the sudden creation of an oversupply have effectively 
called into question the relationship between program approval and concep- 
tions of state interest. As long as there was a chronic shortage of teachers, it 
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was at least arguably in the state interest to approve institutions and programs 
known to be demonstrably deficient even in basic ways. But the present situa- 
tion may mean that other expressions of state interest can and will assert 
themselves. And this leads to the question whether there currently exist or 
can exist systems of program approval under which institutions and programs 
are denied approval on grounds of not fulfilling state interests. 

I wish to come at this question indirectly, first creating a context 
which will hopefully move the question from its pure abstract form to the 
realities of day-to-day program approval. As I have noted, program approval 
shares many characleri sties with private accrediting. One of the most deleter- 
ious features shared by the participants in both processes is the tendency to 
conduct business in private and avoid public disclosure. Since both processes 
are in fact, if not in theory, engaged in public business or business strongly 
affecting the public, the processes and actions emerging from them must see 
the light of day. Mitchell Wendell has observed: 

Teacher certification agencies operate processes in which the 
officials and employees may in fulfillment of their human nature 
prefer not to respond to inquiries about the types of records they 
keep or their content. This is likely to be in relation to the cri- 
teria they employ in determining whether particular applicants 
should or should not receive certificates and the weight they as- 
signed to pieces of information or allegations contained in indi- 
vidual files. It is probably not that many of the decisions would 
likely be found wrong. Rather, it is that they might be trouble- 
some to document or justify in a way that would appear to all 
as scientific and objective. ("Freedom of Information Statutes, 
Teacher Certification Agencies, and School Systems," State Edu- 
cation Department, Interstate Certification Project, New York) 

What applies to individual certification cases may apply as well to institutions 
and programs. I have no evidence that program approval is not public in all 
states. I can only testify that I have personally been subjected to intense 
pressures from a variety of sources to keep out of the public record items 
tending to embarrass institutions and otliers in a system that one might 
characterize as only minimally public. 

I know of no system that assures that program approval staffs will 
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resist the temptation to adopt a policy of consensus and appeasement with 
regard to institutions. Integrity and courage certainly assist. But perhaps Hie 
creation of public bodies th.-it review all tlie available relevant information 
and the judgments of staff persons and come to their independent conclu- 
sions in public will augment integrity and courage and assist in replacing 
appeasement with a more defensible strategy. 

In addition to creating program approval systems open to meaningful 
public inspection, program approval systems must in niy view become more 
adversarial in character if they are to realize their potential. Given the present 
character of many program approval systems, it is virtually impossible to pre- 
tend that the record concerning an institution and its programs is complete, 
accurate, and valid. Typically, the sources of information are limited to the 
institution itself, visitation teams, and state agency files. Tlie visitation pro- 
cess, a key component in this whole process, is unavoidably prone, it seems, 
to producing tons of irrelevant or virtually meaningless prose and to bias, and 
is vulnerable even to outright misrepresentation. At present, the program 
approval process depends almost exclusively on human testimony and conse- 
quently has all of tlie problems attendant to relying on human testimony 
when making decisions. But typically program approval systems have none 
of the protective mechanisms available in other areas where human testimony 
is heavily relied upon. 

Now, let's be clear that human testimony must be relied upon. Any 
meaningful evaluation of any kind of education program must, it appears, 
rely at least to some extent on human testimony. Tlie problems raised by 
human testimony need not lead to excluding it from consideration but 
rather to insuring that it is legitimately employed in balancing the interests 
and rigiits of institutions and others against state interests. 

1 have taken this long way around the question 1 raised earlier— on what 
basis does one deny approval to an institution or program— in order to set in 
a meaningful context some more dramatic issues. Before issues relating to the 
use of human testimony arise, there are some other problems needing exam* 
ination. Tliey can be formulated easily but resolved with only the greatest of 
difficulty: (1) Wliat issues are involved in approving or disapproving an insti* 
tution? and (2) What are the points of controversy? Theoretically these 
problems should be easily answered because one would assume that reference 
to the state interests served by certification would define the issues and 
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points of controversy. It should be a simple task to say what is at stake in the 
approval process, if only by reviewing legislative statements as to what 
schools are encouraged or mandated to do. Inspection of relevant statutes 
and rules and regulations is, however, frustrating. Not only do patent con- 
flicts appear, but state legislatures are prone to mandate teacliing of the 
contributions of ethnic groups, conservation, state hiotor>% citizenship and 
patriotism, bilingual education and so on. These expressions of state interest 
frequently do not coincide with the departmental structures of higher educa- 
tion or paradigms of twentieth century knowl-^dge. And judicial expressions 
of state interest have historically tended to stress citizenship and preparation 
for effective participation in social, political and economic processes. One 
opinion, for instance, argues that: 

We are a self-governing people, and an education prepares the 
boys and girls for the duties and obligations of citizenship. 
Neither tlie schools nor the state can carry on witliout rules or 
laws regulating the conduct of the student or citizen, and those 
who are taught obedience to the rules and regulations of the 
school will be less apt to violate the laws of the state. 

At best, the relationship between program approval and putative state inter- 
ests is not easily articulated; at worst, one cannot even discern it. We can 
perhaps best recognize this state of affairs and settle for a less than ideal and 
vaguely stated policy that what is at stake in the approval process is whether 
the institutions and programs are responsive to public school staffing needs. 
If even tliis vague policy statement is adopted, the i3sues and points of con- 
troversy become clearer. But of course the controversy is not settled because 
one must rely on human testimony to make the necessary determinations. 

The problems created by human testimony range from competence to 
credibility, from bias to the failure to provide, or deliberate withholding, of 
evidence of acceptable quality. Certainly one has to recognize that human 
testimony gains its worth and credibility trom the human being providing it. 

And these facts create additional problems because at present in the 
systems of program approval I am familiar with, assessments of the "human 
being offering" the testimony are virtually impossible for institutions, 
decision-makers, and others who have interests or responsibilities. There is 
little possibility for an institution, for instance, to challenge an evaluatcr's 
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perceptions and for decision-makers to tease out the nuances of his state- 
ments. WhUe a system of cross examination appears impossible, at least at 
present, I suspect we can improve the state of things by enabling institutions 
and other interested parties— individual teachers and their organizations, 
parents, prospective employees, students—to respond in writing to the evalua* 
tor's perceptions and statements, include those responses in the record, and 
seriously consider them in the review process. 

While this creates a somewhat mess>' procedure—conflicts and embar- 
rassment, and even bad manners may frequently occur—it appears to me that 
if tliese conflicts can be brought home on questions having to do with state 
interest in the certification process, the approval system itself seems to 
clarify thi.- stat^* interest or at least ouUine competing theories of state 
interest. 

Peihaps the most dramatic but increasingly real way of focusing the 
questions we are dealing with is consideration of this question: Wliat is the 
character of the evidence necessary for an official or public body to declare 
that an institution and its programs are not serving the state interest and 
therefore ouglit to be denied the right to train teachers? Or, one can put the 
question in even a more troublesome way: What is the character of the evi* 
dence necessar>* declare that state interests are being served? 

We have, in the past and perhaps continue, answering these questions 
by relying more on rules than on what I will refer to as standards. We have 
tended to set out prespecified behavioral statements, on the order of rules 
governing driving automobiles. We have assumed that rules analogous to tliose 
requiring drivers to stop at red lights have protected the general welfare and 
promoted state interests. Such rules are nice because one need not make any 
inferential leaps, for in all cases the "facts speak for themselves.'' And in 
talking to obstreperous clients on the phone, one can be at ease knowing 
full well that the rule and evidence for compliance are synonymous. The 
bureaucrat on the phone does not have to engage his mind defending any 
inferences and those of us who have received the same calls can continue to 
ignore the fact that in considering flie protection of state interest all one 
has at hand is circumstantial evidence. We can thus deny that somewhere 
along the line we depend on suggestion, analogy, inference, metaphors, and, 
yes, even s^'bliminal cues. 

Rather than relying on narrowly construed rules, I would argue that we 
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seek to enforce standards rather than rules. While more ambiguous, standards 
at least admit of the possibility of raising significant questions, of engaging 
the judgments of several individuals, and actively seeking to render certifi- 
cation as a means of protecting state interest, which is probably dynamic 
rather than static. Rather than specifying in advance what evidence will be 
persuasive, we need to be open to an adversarial context. Tliis. of course, 
means that institutions will have to develop the guts to stand up and fight 
for programs they believe serve the public interest, and one can foresee pro- 
fessional associations, community groups and. others doing the same. And, 
such a strategy of course means that state departmental staffs must be made 
and held accountable to some sort of public body and forced to reply to 
positions advocated by others. Such a context would quickly produce some 
hard work on issues that continue to be ignored— what kinds of evidence can 
be allowed to be brought under consideration and what kinds of inferences 
can ^e made in attempting to determine whether an institution and its 
programs are serving the state interest. 

I am aware of the temptation to close a paper like this one with a plea 
for further research. But I suspect that the solutions to the difficulties we 
face are more likely to arise in less disciplined and more fascinating ways. I 
would suggest that in working on these problems we do the follov^g: 

(1) attend to the naturally articulated, if frequently imprecisely 
stated. Concerns of teachers, parents, administrators and others; 

(2) assume that "state interest" is not a static thing with a logical 
character but dynamic and socially and historically produced; 

(3) that the "education of educational personnel" embraces a wide 
variety of processes and is not a single process for which "reality" 
can be claimed; and 

(4) that continuous critical reflection on our day-to-day efforts-our 
ordinary talk and behavior— may provide direction in devising 
standards and systems enabling us to make more reasonable and 
useful decisions. 



I wish to acknowledge the influence and assistance provided by Robert L. Wolfs 
provocative dissertation: *'TTie Application of Select Legal Concepts to I-ducational 
Evaluation/' University of Illinois, December. 1973. 
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GENERAL DESCRIPTION OF THE ACTIVITIES 



ASSOCIATED WITH REVIEWS OF 
INSTITUTIONS AND PROGRAMS 

By Lawrence D. Freeman 



Tenth Year Periodic Review 

The Tenth Year Periodic Review falls into four phases: (1) preparation 
of the institutional report. (2) the team visitation and validation of its report. 
(3) the assessment of available information and development of recommenda- 
tions by the staff, and (4) action by the State Teacher Certification Board 
and Superintendent. 

Preparation of the Institutional Report 

The Institutional Report should be a succinct and accurate description 
of the institution and its teacher education programs. It should be suffici- 
ently detailed to provide adequate information for assessing whether the 
institution and its programs comply with the standards and criteria. The 
standards address mainly the place of teacher education within the institu- 
tion and its commitment to teacher education; the criteria are more specifi- 
cally focused on programs. Program as used here refers to a structured 
sequence of learning activities and experiences designed to lead to a specific 
certificate and endorsement. Gear distinctions between required and elective 
components in each program should be made including academic and in 
clinical work. A description of the integration of general education, academic 
specialization and professional education for each program should be pre- 
sented. 

The report should cover unique aspects of the institution and any ex- 
ternal relationship such as contractual relationships with other IHF*s or with 
LEA*s for teacher education purposes and any governing Board policies, 
e.g., the Board of Higher Education mandated relationship to cornmunity 
colleges. Tlie report should also make clear distinctions betw<Jen **what-lias- 
been-and-is-being-phased-out/' **what-is>'' and **what-is-planned."" And the 
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report should indicate throughout, if possible, where written documentation 
for various aspects of institution and programs can be found. 

There is no imposed fomat for the report. Difficulties tend to arise in 
four areas: fiscal data, faculty data, library and curriculum materials, and 
ancillary and off-campus activities. h\ all cases, the data presented should be 
determined by the relevant standard or criterion. Summary of data with 
trends or general characteristics should be sufficient, with more detailed 
information available to the visitation team as needed and requested. Ancil- 
lary and off-campus activities reported should be presented as part of, or 
otherwise directly related to, programs being reviewed. 

During the preparation of this report-which frequently begins one and 
a half years prior to the date of the visitation-IOE staff are assigned to work 
with the institution. The character of this liaison work is that of technical 
assistance. Tlie staff meets with institutional representatives to explain the 
meaning of the standards and of the criteria and the kinds of information 
necessary to make the determinations that will have to be made during the 
program review process. In most instances, such liaison requires actual pres- 
ence on a campus twice, sometimes more frequently, and meetings between 
institutional representatives and staff in Springfield. It is during these liaison 
activities that the staff begins to achieve an understanding of any potential 
difficulties or excellencies that the institution may possess. Records of liaison 
contacts are maintained so that there is a complete record of what has tran- 
spired between the staff and the institution. It should be noted that the staff 
in no way writes the report for the institution or does more than offer assis- 
tance in suggesting kinds of information or evidence and potential sources 
for the information and evidence that should be presented in the report. We 
regard this phase of the Tenth Year Review as crucial because it begins the 
development of a record on which decisions will be made. The staff is con- 
cerned that the institution be accurate and represent the state of affairs as it 
actually is at the institution at that time. 

Visitation 

The visitation team is made up, in accordance with State Teacher 
Certification Board rules and regulations, of school teachers and adminis- 
trators, and college and university faculty and administrators. The selection 
of team members is done by an lOE staff member who is designated by the 
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Director as the chairperson. Tlie team members are approved by- the Director. 
All team members are from Illinois, and where possible (in accordance with 
State Teacher Certification Board policy) include a State Teacher Certifica- 
tion Board member. In the case of public institutions, a staff member from 
the governing Board may also be asked to serve on the team in an ex officio 
capacity. In all cases but those of the State Teacher Certification Board 
member, the chairperson and any other lOE staff and staff from a governing 
Board, the institution and each team member is asked to indicate whetlier 
there are past or present relationships between the institution and members 
of the team which constitute, or may be construed as, a conflict of interest. 
When grounds for a conflict of interest are alleged they must be set forth ir 
writing. In no case can an institution veto team members. lOE assume 
responsibility for assembling a competent team, though it does not pretenu 
to select "unbiased" team members. The team will have enough members to 
examine each and every program in detail. No team member will review more 
than two programs in normal circumstances. The team is instructed in writing 
by means of a general charge to the team, and each team member receives a 
written charge regarding his specific responsibility. These charges are shared 
with the institution. These instructions indicate that the visitation team and 
its individual members are to engage in a fact-finding effort designed to gener- 
ate information sufficient to determine whether an institution and its pro- 
grams comply with the standards and criteria. 

The team . is not, as is the case in voluntary accreditation, a recom- 
mending body and does not determine whether the institution is in compli- 
ance. The team is directed to investigate relevant written documentation and 
to interview students, faculty, cooperating school personnel, administrators, 
and other persons deemed to have relevant information concerning the insti- 
tution and its programs. After each team member has filed a report with the 
chairperson,- the lOE staff lightly edits materials supplied-deleting only 
clearly irrelevant statements and corrects grammar and spelling. It is then sent 
to team members for corrections, additions, or deletions. It is simultaneously 
sent to the institution R^Jhe institution is asked to make written responses to 
errors in fact indicating where and how its version of the facts can be sub- 
stantiated. Where the institution feels that bias or a perspective alien to its 
own has been imposed by a team member, the institution is invited to 
respond setting forth its view of the matter. Where the institution's version of 
the facts is substantiated, corrections are made in the report. In other cases, 
the institutional response is incorporated into the team report and noted as 
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an institutional response. Institutions are given one month to six weeks to 
respond. 

Staff Analysis and Recommendations 

The purpose of the team report, as well as the institutional report, is 
to prepare a record of information that is comprehensive, accurate, complete, 
and that oftentimes includes conflicting points of view. The staff reviews 
the institutional report, the team report, and any other relevant information 
that has come to it in terms of the standards and criteria. State Teacher 
Certification Board rules and regulations, and relevant statutes. The staff 
prepares an analysis for the State Teacher Certification Board and the Super- 
intendent in which it discusses the information in terms of the standards 
and criteria and in which it sets forth recommended action by the State 
Teacher Certification Board and Superintendent. Recommendations are made 
concerning the institutions, recognition for teacher education purposes and 
for approval of each program for teacher education. During this process of 
preparing the staff analysis and recommendations, staff (where uncertain or 
where conflicts arise) is in touch with both representatives of the institution 
and individual team members as it seeks to work out difficulties. Staff analy- 
ses are drafted by a staff member who has not served in a liaison capacity 
with the institution, has not chaired the team, or participated on the team. 
This draft is then reviewed by the Director, often rewritten, and frequently 
given to another staff member to challenge, with yet another draft prepared. 
After the results of this process are in, oftentimes all those involved get 
together to work out any differences. The usual concern is the relationship 
of evidence to recommendations and construing the standards. 

Action by State Teacher Certification Board and Superintendent 

The Superintendent, in consultation with the State Teacher Certifica- 
tion Board accepts, rejects, or modifies the staff recommendations. These 
actions, including any appeals by the institution, are described in the Manml 
adopted in March, 1975. 

Fifth Year Periodic Reviews 

The Rfth Year Periodic Review falls into three phases: (I) the prepara- 
tion of an institutional report, (2) staff review and preparation of an analysis 
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and recommendations, and (3) action by the Superintendent in consultation 
with the State Teacher Certification Board. 

Preparation of the Institutional Report 

The preparation of the institutional report proceeds in the same way 
that reports are prepared for Tentli Year Reviews. In some cases, however, 
NCATE reports are used in lieu of a separate report prepared especially for 
the Fifth Year Review process. In non-NCATE cases, the staff provides liaison 
and visits a campus usually at least twice during the prepai ition of that re- 
port. In NCATE cases, the staff will serve on tlie NCATE team and frequently 
is involved in liaison activities as the institution prepares its NCATE report. 
If the NCATE report does not, in the judgment of the staff, provide suffi- 
cient information for the Fifth Year Periodic Review, the instit""'^Mi is 
requested to prepare an addendum. In some cases the staff also h" to 
the NCATE team report and to materials that an institutior ay iiu 
pared in meeting with representatives of NCATE. 

Preparation of Staff Analysis and Recommendations 

This process is much like that used in the preparation of staff analysis 
and recommendations for the Tenth Year Review process. The staff review 
focuses in three areas: (1) compliance with the requirements for certification 
imposed during transcript evaluation, (2) whether the institution and its 
programs comply with the standards and criteria as can be determined in the 
absence of a visitation team report, and (3) contacts the institution request- 
ring, further information clarifying items about which the staff is unsure or 
unclear. 

Action by the State Teacher Certification Board and Superintendent 

In accordance with the Manual, the Superintendent (in consultation 
with the State Teacher Certification Board) acts to accept the Fifth Year Re- 
port. If the report is unacceptable, the Superintendent (in consultation with 
the State Teacher Certification Board) may withdraw recognition of the insti- 
tution or approval of one or more of its programs. 

New and Modified Program Reviews 

In the case of proposals \o ^sponsor a new or modified program, the 
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institution first notifies the Secretary of the State Teacher Certification 
Board that the institution intends to develop a new program or to modify an 
already existing one. At this point a staff member is designated to provide 
liaison to the institution. The liaison is of a technical assistance character with 
the main activities beinft explaining and exphcating the standards and criteria 
and the processes through which the proposal must go. This liaison involves 
visitation to the campus and a general overview of resources and interviews 
with faculty and administrators. The concern of the staff here is to insure 
that the institution presents sufficient and accurate information so that it can 
make a recommendation. Under the procedures outhned in the Manual, the 
institution's designated officer must request of the Secretary of the State 
Teacher Certification Board that its program be acted upon by the State 
Teacher Certification Board and the Superintendent. The preparation of staff 
analysis in the case of new programs involves a review of the program against 
the standards and criteria set forth in the Manual, state statut'^s, niles and 
regulations, and policies tliat have evolved thron"^^ {. ion of the 

Superintendet ' he State Teacher Certificatit. ' 
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CHARACTER AND USE OF EVIDENCE 



IN PROGRAM APPROVAL 

By Lawrence D. Freeman 



In review of institutions and programs, a number of issues surrounding 
the availability and use of evidence come to the fore. Four such issues are 
illustrated below: (1) Kinds of Evidence, (2) Reliability of Evidence, (3) Rele- 
vance of Evidence, and (4) Sufficiency of Evidence. 

I. Kinds of Evidence 

An examination of institutional and visitation team reports reveals that 
most evidentiary material can be classified as one of four kinds: 

A. Verifiable factual evidence is usually of a quantative o: documen- 
tary nature, consisting of transcripts, records, minutes, and so 
forth. This evidence qualifies in most instances as direct evidence 
in support of claims. 

B. Human Testimony 

1. Direct human testimony provides a description of the report 
writer's observations, perceptions, and activities. 

2. Inferences usually appear in the report when a writer presents 
judgments about a program or one d' it aspetojs, itrr when the 
writer tries to resolve conflicts in ev ,u tiaip' imrerial he has 
gathered. 

3. Indirect human testimony consists of J^.; wrircriK reports and 
summaries ofinterviews and conversatic^s Esmtmttts: 

a. Advisors in each department are.giwsai2iEEmrto complete 
concerning their assessment of tfe:aiainiidate'^s potential 
for success in .a teacher educatinr. grtM^rmn. (Factual 
Evidence) 

b. It wasireported that no student isr%mED?d toathe teach- 
ing prnsram without the approvalucaoiwiEltten^assessment 
of theriiistory department. (Ind^'H^nrtHunnani Testimony) 

c. An £S2Emination of some stude- « ^Sie& in: ihs education 
office confirmed that some studur i&om tibe history de- 
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partment are admitted to the teacher education program 
with tlie form incomplete. (FactuiJ Evidence) 

d. The bottom line of this form contains room for written 
comments. Those observed were short and superficial. 
(Direct Human Testimony) 

e. The possibility exists that the department of history may 
not give its approval to the student. If this occurs, it may 
mean that the assessment by that department is viewed 
as more reliable than the performance data compiled by 
the department of education. (Inference),, 

n. Reliability of Evidence 

Several issues repeatedly occur in assessing the reliability of various 
kinds of evidence. Evidentiary statements frequently do not occur in "pure'* 
form as in tlie examples above, and even if they do, the sources for eviden- 
tiary material become crucial factors. After reviewing a number of team 
reports, the staff has selected the following statements to illustrate these dif- 
ficulties. 

A. Undesignated source with no elaboration: "There is evidence to 
suggest that the general education program ser/es students well." 
Commentary: By itself this sentence is virtuaDy meaningless. The 
reader of this sentence has no clue as to the kind of evidence re- 
ferred to or the sources of evidence. Such highly generalized state- 
ments are regarded by the staff as highly unreliable. 

B. Summary of a number of conversations and interviews with -de- 
signation of source by title: "Interviews with students, graduates, 
teachers, and school administrators revealed that most students 
are inadequately prepared for student teaching." Commentary: 
This statement* is stronger than the preceding one, but it raises:a 
number of questions, such as how many persons in the various 
roles were spoken to, how did the writer elicit this information, 
and was the testimony as consistent and unanimous as the state- 
ment implies? 

C. Designated Source: "Dr. Smith indicated that he has been in con- 
stant contact with local school personnel. Three teachers, Ms. 
Barrow at Willow, Mr. Clark at King, and Ms. Ogden at Middle- 
brook, confirmed this." Commentary: Such a statement inspires a 
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high degree of credibility. The statement is specific with respect 
both as to what is being asserted and sources of information. 

D. Inference: "This is an excellent procedure, but not if it is to the 
exclusion of additional experiences with the age level of children in 
which they are most interested." Coiniiientary: This statement 
clearly offers the writer's judgments on an aspect of the proguain. 
Its reliability will probably be governed by the context in which it 
appears; that context is likely to indicate whether the writer is 
given to unwarranted bias or is a reliable and perceptive observer. 
Oftentimes inferences made by writers appear to be insignificant 
upon first reading but come to be extremely important since they 
serve to assign relative importance to other kinds of evidence. 

E. Team Member's Testimony: "Dr. Smith's claim that classes are 
very small and the instructor is able to do much informal evalua- 
tion of students was substantiated by visits to seven classes." 
Commentary: This statement is regarded as highly reliable. One has 
the sense that the writer is tapping a number of sources of informa- 
tion and is seeking to develop an accurate and complete record. 

F. Documentary Evidence: "The catalog states that students in this 
program are required to complete a course in the rt\ethodology of 
teaching social studies, a fact confirmed by examination of tran- 
scripts." Commentary: In this instanccithe statement appears to be 
incontroveiitible. Two sources of dooumentary evidence provide 
consistent imformation. 

The commentary about each of these examples ignores the contexts in 
which they appear. Frequently, statements of apparently low reliability gain 
credence when essentially the same observation appears with differing degrees 
of reliiability throughout the team report. 

Assessing the reliability of evidence is difficult, particulaiir/ when con- 
fronted by conflicts in the evidence. This is particularly the case wdren, for 
instance, commentary by students and cooperating teachers, who are often 
unideTrtified, conflicts with data., gathered by a program evaluation system, 
with records maintained by the institution, or even with commnatary by 
identified representatives of tlie institution. Reports concerning cocjperating 
teacher and student perceptions are particularly difficult to use at face value 
because it is often unclear how many people were talked to and whether 
their statements were virtually unanimous. 
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* A constant concern of tlie staff is how to resolve conflicts fairly and 
how to determine what kind of evidentiary material should be given prefer- 
ence. 

IIL Relevance of Evidence 

In some instances, the relevance of evidence to one or more standard 
or ciriteria is not difficult to establish. This is particularly true when treating 
the standards and criteria as "rules." There either are or are not objectives, 
methods courses, required clinical experiences. In other instances, however, 
the relevance of evidence is not so clear cut. For instance, the criterion that 
requires "that the program provides for acquisition of knowledge . . . neces- 
sary for effective performance in specific teaching . , . roles," frequently 
creates difficulty. Usually two issues arise: the character of the role for which 
the person is being. 'prcT>ared and what is needed to perform effectively In it. 
Foi .iibUHiv-e, a team miember observes: that an Englisti program does not re- 
quire instruction in Treading and that secondary Engiish teachers frequently 
encounter reading difficulties in the classroom. In responding to such obser- 
vations, the staff does the following: 

A. Insures that statutory requirements amd State Teacher Certificatiom 
Board rules::and regulations are nnfit. 

B. Insures that A-160 requirements andiieimbursement requirements: 
if any, are met. 

C. Tries to determine if the institution! is evaluating its program and 
whether that data suggests requiring an-eacing course. 

D. Consults with Illinois Office of Education staff who work witn 
school personnel in the areas ofiEnglish and reading. 

E. Reviews available professional literatune . 

F. Reviews past actions in similar situations. 

IV. Sufficiency of Evidence 

Determining whether or not there is sufFfcient evidence to sustain a 
recommendation is an extremely difficult task. Questions arise from time to 
mne, for instance, whether an action can be based on a single sentence writ- 
ten by a team member or on a general description lacking in specific detail. 
More frequently the difficulty is created by conflicts in the evidence regard- 
ing a particular matter. This sort of dilemma was considered above. At 
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present, where such conflicts occur and are not resolvable, the staff tends to 
recommend provisional approval. Approval or denial of approval is recom- 
mended only when tliere is a clear preponderance of evidence supporting such 
action. 

All of these considerations lead to yet another vexing issue: how many 
criteria or standards must be violated before denial of instead of provisional, 
recognition or approval is recommended? Several kinds of considerations 
must be made at this point— which standards or criteria are violated, the 
extent and nature of the remediation required, the institution's commit/^^oiU 
nnri re*^ irces, nnd how a standard or criterion is to be applied in a particular 
. llius, 'eci iuii Tn recommend either denial of approval or provi- 
sional approval is likely to depend on a pattern or configuration of evidence 
revealing substantive violation of one or more standards or criteria. 
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DUE PROCESS FOR INSTITUTIONS AND STUDENTS: 



IMPLICATIONS FOR PERIODIC REVIEWS 

By Lawrence D. Freeman 



Issues concerning due process for institutions, students, and others 
during periodic reviews arise from the fact that the Manual explicitly provides 
for the posability of denial of institutional recognition for purposes of teach- 
er education. The act of denying recognition (1) excludes institutions from 
the group of institutions authorized to prepare teachers, (2) excludes students 
from the group eligible for certification, and (3) may deprive faculty of their 
means of livelihood. All these groups-the institution, students, and faculty- 
may well allege that recognition constitutes a business advantage or a proprie- 
tary interest. Thus, the problem becomes one of protecting this advantage or 
interest while at the same time protecting the state's interest in certificating 
able and competent school personnel. ' ! 

At the moment, legal trends suggest that in acting to exclude institu- 
tions from accredited or recognized status, institutions may well assert that 
they have rights or interests to be protected. Currently, there is little case 
law that provides definitive guidance. But a case involving Maijorie Webster 
College, a proprietary institution, and Middle States Association, a voluntary 
accrediting association, may serve to illuminate some of the central issues. 

Maijorie Webster College, a proprietary institution, sought to apply for 
accreditation by Middle States Association, but Middle States refused even to 
consider the appUcation because it had an eligibility rule excluding proprie- 
tary institutions such as Marjorie Webster. The central issue in the ensuing 
litigation became whether the rule excluding Marjorie Webster was defensible. 
In this particular case, secondary considerations were (1) whether Middle 
States' exclusionary rule acted to restrain commerce and (2) whether "educa- 
tion" constituted commerce. The district court found the Middle States rule 
indefensibly exclusionary; the appellate court reversed this deciaon finding 
for Middle States. On appeal, the Supreme Court refused to hear the case. 
Thus, the deciaon in this particular case suggests that different criteria are 
applied in judging the exclusion of institutions from certain benefits than in 
other sectors of the economy. 
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The debate, and some of the issues, that this case has raised are illus- 
trated by the commentary of Donald Bakvr, Director of Policy Planning for 
Antitrust Division of the Department of Justice: 

I personally think that this case was decided wrongly, even on 
its own facts. To the extent that it rests on judicial deference to 
the nature of the underlying subject matter-education-it is a 
unique little aberration in the law. Secondly, the association's 
flat refusal to consider Maijorie Webster for membership seems 
entirely inconsistent with the Supreme Court's decision in Silver 
V. New York Stock Excharisie, which required procedural due 
process for exclusion. Thirdly, the court's analysis of economic 
effects was inconsistent with the rationale of Associated Press 
and Silver. The test has never been whether an enterprise could 
survive without membership, but whether membership was an 
"important business advantage." ("Antitrust and the Non-Profit 
Organization,'' A/(9/7-/^/7r/^pc?rr, March, 1973, p. 17.) 

Some issues remain unsettled. Whether states, for instance, can be found to 
engage in monopolistic actions inrviolation of antitrust statutes remains un- 
clear and at this point is mostly a theoretical argument. But if the challenges 
being raised concerning voluntary accreditation are any guide, challenges of 
program approval decisions based on broad due process considerations can 
be anticipated when actions to excluide are taken. 

William Kaplin suggests that in situations analogous to program ap- 
proval: 

Procedural due process would minimally require administrative 
regularity, reasonable relationship between the decision-making 
process and the stated purpose of tlie agency and opportunities 
for the affected parties to present their views in a manner com- 
mensurate with the interest which they have to protect. To 
ensure due process in accrediting, established standards and pro- 
cedures should be followed, schools should be given adequate 
notice and explanation of adverse actions, an opportunity to 
show cause why it should not be taken, and the opportunity to 
obtain a hearing and (should adverse action be taken) on appeal; 
the accreditation body should be free to act without conflict 
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of interest, pursuant to the evidence and in accord with estab- 
hshed standards and procedures. (Quoted from Orl.ans, et aL, 
Private Accreditation and Public Eligibility, 1974, Vol. I, pp. 
177-78.) 

, It is reasonable to assume that students do enroll in institutions and 
their programs because of state recognition or approval. Counselors at loca) 
high schools and two-year colleges base their advice to students upon infor- 
mation provided by the state education agency. Whetlier that information is 
intended to be used as such or not, state recognition and approval is inter- 
preted as endorsement of institutions and programs. 

Students who enroll at recognized institutions and in approved pro- 
grams expect to graduate and obtain professional certification by entitlement. 
If institutional recognition or program approval is withdrawn while a student 
is enrolled, that student is confronted with the potential loss of a means for 
securing a livelihood. Because current procedures do not provide due process 
for those interested students, their rights may be abridged by an ex post facto 
application of authority. 

Arguably, faculty may also have rights. Individual faculty members 
may have elected employment because of state recognition and approval. 
As in the case of students, faculty members thus have a proprietary interest 
in their affiliation with given institutions. If recognition or approval is sud- 
denly withdrawn, the immediate earning power of a faculty member is 
threatened. Further, the effect on the individual's professional reputation 
could be damaging to the extent that their earning potential is reduced. 
Unless due process is accorded, the individual rights of these persons may be 
violated. 

Recent student protection cases, Peter Doe and its^progeny, as well as 
the policy research concerning student protection (including prospective 
teachers) being undertaken by the American Institute of Research for the 
Fund for Improvement of Post-secondary Education, suggest that in the case 
of adverse action, students as well might have proprietary rights at stake since 
they have enrolled and pursued their studies in good faith and with the bless- 
ing of the state. The principle that the catalog under which the student enters 
represents a contract seems to suggest that if the institution truthfully repre- 
sents itself and its programs as recognized and approved, denial of recognition 
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or approval may need lo be implemented so that present students are allowed 
to fmish their work. 

The extent of faculty ''rights*' is unclear but the United States Supreme 
Court's ruling in Board of Regents v. Roth may mean that individual faculty 
have a right to a hearing where his "reputation or integrity" is at stake or 
where a stigma or otlier disadvantage foreclosing the "freedom to take ad- 
vantage" of other employment opportunities may result. 

The issue then becomes balancing institutional, student, and perhaps 
faculty interests and rights against the interest of the state in certificating 
competent and weil-prepared school personnel. Due process considerations 
are obviously not the only considerations; compUance with standards and 
criteria as expressions of state interest are controlling and take precedence. 

Caution with respect to due process, however, may be critical, given the 
character of present technology available for assessing institutions and pro- 
grams. In 1972, Jerry MUler and Frank Dickey in A Current Perspective on 
Accreditation observed that while accrediting practices vary considerably 
they share common features: 

Lacking adequate indices and proven techniques of measurement, 
and occasionally lacking adequate concepts of educational ef- 
fectiveness or excellence, accrediting agencies have been forced 
to rely more than is ideally desirable both on personal judgments 
which are fallible and on quantative factors which do not always 
have a direct or proven correlation with excellence. 

What all of this means is that the program approval process in Illinois 
must concern itself extensively with both procedural and substantive due 
process. Procedural process is provided for in the Manual adopted in March, 
1975. Substantive due process, essentially, has to do with protection from 
arbitrary, capricious, and irrational actions. While not precisely defmed, sub- 
stantive due process has to do with fundamental values that emerge when 
individual and governmental interests compete. 

In the context of program approval, the questions associated with 
substantive due process can be summarized as follows: Is the character of the 
avaUable evidence sufficient to render the contemplated action (approval, 
denial of approval) rational, fair, and consistent with stated policy? 
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RESEARCH LAGS- AND INSTITUTIONAL BARRIERS 
AFFECTING COMPETENCY-BASED 
TEACHER EDUCATION IMPLEMENTATION 

REPORT OF THE SPECIAL LEGAL ISSUES 
CONFERENCE OF THE MULTI-STATE CONSORTIUM 
ON PERFORMANCE^BASED TEACHER EDUCATION 



By Sheila Huff 

Sheila Huff is a Research Fellow at the Educational Policy Research 
Center, Syracuse Research Corporation— a group which has engaged in federal 
level policy analysis since its founding in 1967. Ms. Huff is currently a case 
study team leader in the NIE sponsored evaluation of Title I, ESEA Admin- 
istrative Practices. Her graduate training was in philosophy with an emphasis 
on the social sciences and education. She served as Research Associate and 
Acting Director to the Task Force on Competency-Based Education spon- 
sored by the Fund for the Improvement of Postsecondary Education and has 
authored several papers and articles on education, work and the law. 
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RESEARCH LAGS AND INSTITUTIONAL BARRIERS 



AFFECTING COMPETENCY-BASED 
TEACHER EDUCATION IMPLEMENTATION 

By Sheila Huff 



Prior to 1973, I studied fair employment practices cases following the 
Supreme Court Griggs v. Duke Power Company decision (401 U.S. 424, 
1971) in an attempt to discern the possible implications of these cases for 
education and the education/work nexus. ^ My interest in and attention to 
both employment selection and licensing litigation continues but does not 
approach thorougliness nor the special understanding of the legal scholars 
I've come to depend upon-David White and Michael Rebell. Both thorough- 
ness aiid specialized theoretical understanding of the law will be necessary to 
deal with many of the pressing problems and questions you bring to this 
conference. If I have anything special to contribute, it would have to do with 
my rather accidental assignment to several discrete federal policy analysis 
projects at the Education Policy Research Center in Syracuse (EPRC/Syra- 
cuse): one on statewide accountability, one on the implications of the Griggs 
decision for education, and one on the problems and prospects of compe- 
tency-based education. They are to be sure integrally related, but it was quite 
by accident that they were merged in my thinking. 

For the past two years I have been primarily involved with competency- 
based education. Thomas Corcoran— then with the EPRC/Syracuse and cur- 
rently with the Fund for the Improvement of Postsecondary Education— and 
I assembled a task force which set out to discover what competency-based 
education was all about and what its problems and prospects might be. Since 
there were other task forces attending specifically to competency-based 
teacher education, we asked Fred McDonald of Education Testing Service 
(ETS), Director of the National Commission on CBTE, to join our team 
which would focus on professional, occupational and liberal education. 



Reported in Sheila Huff, **Credentialing by Tests or by Degrees: Title VII of 
the Civil Rights Act and Griggs v. Duke Power Company,"* Han'ard Educational Review, 
Vol. 44, No. 2 (May 1974). 
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Among the many things we discovered was that outside of teacher 
education there was no one model and no stipulated definition of the mean- 
ing of competency-based education. Each of the institutions with up and 
running CBE programs bore some resemblance to the others, but we could 
discover no essential commonalities. In CBTE, however, there were attempts 
to stipulate a model and there were proponents for the movement. Outside 
of the CBTE movement, competency-based programs in other areas seemed 
not to take their cues from the developments in teacher preparation. They 
were engaged in rethinking their institutional missions for a variety of 
reasons, and in the course of doing so, began clarifying goals and asking 
whether the instructional content and processes in their institutions were 
suitable. The language and rhetoric of the CBTE movement seemed appro- 
priate and the special focus funds for competency-based education programs 
of the Fund for the Improvement of Postsecondary Education undoubtedly 
influenced their adoption. Several ideas associated with CBTE were recreated 
and given different labels. Some ideas were directly adopted. Tlie greatest 
difficulties were with the notion of "behavioral objectives" which most 
faculty members outside schools of education choke upon. Phrases such as 
"criteria for idenrifying learning outcomes" or "indicators of the attainment 
of eduGa^onal goals" were more palatable. 

If the CBE and CBTE programs had any one tiling in common, it was 
- the idea of discovering what competence in various adult roles, including 
occupational and professional roles, is about and using that information as 
benchmarks to guide tiie design of their programs. 

Perhaps the first disappointment came when it was discovered by CBE 
practitioners tliat there was precious httle help to be had from the research 
and development community on the realities of competent practice in em- 
— ployment settings and still less on what it miglit mean to be a competent 
adult in American society. Furthermore, unlike CBTE with its National Com- 
mission to organize and coordinate prospective research and development, 
no such projects were slated for other professions and occupations. 

Another disappointment was in the area of assessment of student 
progress. The expectation was that consultants— testing experts— were there 
and prepared to venture into unchartered waters— to phase out inappropriate 
paper and pencil tests, to improve upon the more appropriate ones, and to 
develop performance measures for new or hitherto neglected educational 
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goals. Instead it -was discovered that with rare exception" the testing industry 
was quite locked into traditional approaches. As a result, most of these insti- 
tutions began developing new approaches on their own. The result has been 
some refreshing innovations and the resurrection of some very old techniques. 
These emerging assessment systems attracted the attention of the testing 
industry and there is now developing a supply of thick "how to do it" 
manuals. However, these new methods are highly subjective, for the most 
part, very costly, and time-consuming. Paul Pottinger, in a paper prepared for 
the National Institute of Education (NDE),^ analyzes these problems and sug- 
gests how they might be overcome. 

The third disappointment was in the area of adult learning theory. 
When educators were quite clear about what it was a student should leam 
and how the student would be assessed, they wished to know what kinds of 
learning experiences would be most efficacious— what content and winat pro- 
cess would assure the development of particular kinds of competence. If re- 
search has little to say to the previous questions, it has even less to say to the 
latter."* 

There were, to be sure, further problems-not the least of which was 
convulsive change or development under the pressure of outade funding and 
students on the doorstep. I suggested to Bud Hodgkinson (then consultant 
to many of the CBE programs we were studying) half in jest, that a physical 
examination of faculty and administrators in these new programs ought to be 
given before the conversions and periodically thereafter. We were impressed 
with the volume of Kleenex tissues in use and always traveled well supplied 
with X^tamin C tablets. It seemed tliat changes were occurring far too rapidly 



Numbering among the exceptions were Paul Pottinger and David McCelland of 
McBer and Company; Fred McDonald, Warren Willingham and John Valley of ETS; 
Ruth Nickse of Syracuse Research Corporation. 

Paul Pottinger, "Comments and Guidelines for Research in Competency Identi- 
fication, Definition and Measuren^ent," prepared for the National Institute of Education, 
Contract NlE-400-75-0036, June 1975. Available through EPRC/SRC, Merrill Lane, 
Syracuse, New York 13210 

^See David C. McClelland, "Pedagogy and Competency-Based Education," pre- 
pared for the National Institute of Education, Contract NIE-400-75-0036, June 1975. 
Available from EPRC/SRC, Merrill Une, Syracuse, New York 13210. 
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for the general welfare of the idea of competeoicy-based education. I con- 
cluded that competency-based education was but a distant ideal— something 
to be in part deduced from the realities of practice and in part created out of 
^ concern for the future . . . someday when we understood reality better and 
had a clearer understanding of where we wanted to go. 

Observing the competency-based education scene, it could be said that 
either "there are several different CBE Jeh v^vidence across i''^ c Mr- 
try" or "there are nn C^\l programs to be dii>: * as yet." 

Uiit it is ther^Mo be sure— the comr^^-i!- '-baii^ed movement— forging 
> :>r^j(, being rnandaaed and otherunse ei^iirura^^ for a wide variety of 
r, i^-nrs: (a) on the unerits of the ideal Tnoi^J, to attract students in a 
li; arlcet, {c:j to capture educationaii dev«?0Tnfliemt funds, (d) as an incen- 
t3f\ stimulate self-examination in highe eteation, (e) as a means to 
greater accountability ("make educ tell us what they are at- 
^Ut' ^g to accomplish and when they fail, to > -eep their promises, down 
tilieir c jUars"). 

Why is there a push to convert to conipeiency-based teacher e ducatiosi 
l^efoTe conducting the research which may begin :o satisfactorily answer such 
ii^uestions as "what teacher behaviors or characi^ristics effect what studenr 
^^utcomes?" and "how can schools of education promote these behaviors or 
characteristics in their graduates?" 

Among competing possible justifications, one strikes me as having some 
J^erit. That is, it might be a good idea to have schools of education geared up 
to readily avail themselves of promised research findings. It may be worth- 
while to proceed now to modularize instruction, to clarify objectives, to set 
new decision^making structures in place, to develop more creative approaches 
to assessment // it is the case that students are being at least as well prepared 
they ^vere iri the past. But, of course, we can have no sense of conviction 
that these changes represent reform, since we have no sound evidential basis 
for such judgments-few or no research findings to temper or mediate judg- 
nients of authorities in the field of teacher preparation as to whether CBTE, 
in particular settings and in general, represents an improvement or a setback. 

So, "what is new?" you ask. Perhaps what is new is that never before 
^lid people expect so much from the scientific community and have so little 
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faith in the judgment of experts; and certainix mev/er I^n?i--rt2i,riid\we have a law- 
such as Title VII of the Civil Rights Act of 11964 aacidJvJf'^wTOg, willing liti- 
gants to trouble your minds. In the other pspers W'mc.^r i^^eirJljfsS here and in 
our discussion sessions, we will be exploring thf^ rerrcjiduir<!^fup between 
competency-based teacher education and Tii ■ Vd , so i^j Ux: non go into 
details here. 

I do not wish to be interpreted as clair ' ui . tivv 3M;;-tural, pro- 
cedural, and instructional changes in teacher pr;;p.i;n:;. ^, c>cxirjt3H:^; under the 
rubric of CBTE should not precede the state of tlii; :in re?xr.iiir.:j that would 
help define the dimensions of competent teaching . ^Uj.ucit AM udgment is 
suspended on that matter at this time. I see advantageib- jm^. rjjp-uvantages. I 
wish simply to point out that the vocabulary andn?h?ttEK7v * BTE raises 
false expectations, and I worry that the movement iii?; it W4«tV iied a disas- 
ter area before there are any CBTE programs that bst^^^i-' ta^nm^^ 
model. What is being don^ could be done using lamsu,, ^^th at ;.[;i*>es not raise 
false expectations and f'-.es not so radically misrrep- r, '^ t^r-'.^sv-thereby 
reducing the above risk. 

Returning to the question **\Vhy put the carr. i: - r- rurse?", the 
possible value of promoting changes in teacher educ: - rr- n:zte4irce of sup- 
portive research findings can be seen in the following vijitiisTc' :case where 
research outpaced other changes: the Health Services ^^MiXt^K ^^iuidy (HSMS) 
sponsored by the Manpower Administration of the Dc-: 'i^tGEm uf Labor. 

The Health Services Mobility Study addresses , -^ai^smr shortages in 
health fields. The purpose of the project was to analyze-: xhe "asks performed 
by medical personnel in radiology, nuclear medicine; andjultraisonics. Eleanor 
Gilpatrick and Christina Gullion conducted the study.*' 

Dr. Gilpatrick, a labor economist, wished to caiiiiiiiniici .career ladders 
in these job categories that would be based upon simiimnESiaaid differences 
in various tasks in particular areas— jobs being delinestsii: ttt defined and 



Christina GuUion and Eleanor Gilpatrick, '^Hie Designtot^ruiincuiinn Guidelines 
for Educational Ladders using Task Data," Working Paper No.. lUl (JiiEv. 111^73), Health 
Services Mobility Study, Contract No. 82-34-69-34, Manpower: 4immnEisEration, U.S.- 
Department of i^bor. 
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created on the basis of areas of expent^vS andiskill Tequicsd and their progres- 
sive order of difficulty. Infornnation ti^nm taskianadyses was used to construct 
career ladders and bridges (career laddisrs ap?ilying to movement from one 
level to the next, and career bridges applying nc-niovement from one oncupa- 
tional field to another). The data was also usdi to develop curriculum:miide- 
lines for educational institutions— to be used in the construction of educa- 
tional ladders to parallel career ladders on the job. The idea was that it should 
be possible for people to have access to continuing or recurrent education 
which would enable them to progress along career ladders or to change to 
other health occupations with overlapping knowledge amd skill requirennents. 
Scarce resources of health educational facilitnes and personnel would not be 
washed in redundant training. Students wouldmot need to sit through courses, 
the content of which they had alresidy maistered. Job mobility would be 
increased and worker alienation decreased. 

Gilpatrick's project, in all its phases, was influenced and refined by 
workers themselves, hospital supervisors, professionals on teaching faculties 
and representatives of professional associations, including the American 
Medical Association. The results and recommendations of the study were 
commended by all of these groups as sound and reasonable. All interested 
parties had an opportunity to refine the task descriptions in light of their 
judgment of what comprised the best of practice in the observed areas. 
The research project was well-conceived in a broad socio-economic frame- 
work. 

At the moment, it is questionable whether the work of the HSMS will 
be used to fulfill the purposes for which it was funded. Why? Because the 
primary reason for conducting the research was that it be used to implement 
reforms in licensing and in education for medical occupations and profes- 
sions. No one is using the work currently. Perhaps a few professors revising 
a course here or there may use it to good advantage-but that hardly justifies 
the cost of the project. To ftilly exploit it would require thorough, coherent, 
well-planned systemic changes— that is, efforts in particular settings that 
would involve hospitals (ecnployers), colleges and universities, and state 
licensing agencies. The Department of Labor, National Institute of Health, 
Fund for the Improvement of Postsecondary Education, and the National 
Institute of Education— among interested funding sources— would have to 
cooperate and eradicate jurisdictional barriers to make funding possible. I 
shall outline the work to be done. 
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TL-e occupational licsnsim: struci. r; s out of phase in all staites v.; 
the proposed career ladders. Tfe gives :he hospkiils pause. They hcisitau: 
allow perople who can peirfonn: work reyond tme level at which tttiey iizr 
licensed. Jn facL. to do so is iilegn 

From the perspective of die wonser, what is most often requires to 
niove along a career ladder is a reaum u\ t a dgid, iock-slep formal eiducation 
Diogram that lakes no heed of the afciiiMiies acqmired on the jcib amd ofcsn 
requires full-time attendance. 

Fronn tiie perspective of edmcaticiEial insi.Lmions, the entire incentive 
^structure: conspires against utilizing ;tinii HSMS naaterials to create educa- 
tional programs parallel to career ladde^u Firsr:, of course, there is no incesi- 
tive to create programs to reflect non=sxistenr career ladders. Seconnd, theie 
would be great risk to students, even if the career ladders did exist, if th« 
occupational licensing examinations and prereiauisites were out of phase "Wisrh 
the new programs:. Third, there are no Geclinimg enrollments in theserareasixo 
encourage changq. 

And could one go to the state Ucensing agency and propose reforms? 
Why should they bother with such a tediouis and politically delicate task 
when there is no strong pressure for change? 

My conclusion is that unless we work simultaneously on all three areas 
of reform— the employment setting, occupational/professional licensing, and 
educational programs— no significant disange will nesuit. Moreover, research 
and reform must operatie in tandem. 

Tliis should malei^ you feel somewhat better about the competency- 
based teacher educatioir^movement. Research does^lag seriously; rreform zeal 
has outpaced it. But ycnu do perceive Tiie broad (outlines of whaat you are 
about and you do hav^: your commissnnns and conSbrtia directed at poUcy 
analysis, development imd plarming. Perhaps one day you will ewen have a 
lobby in Congress to aMocate more fumds for basic research on teacher ef- 
fectiveness and adult leamning tlieory. 

Given the story of the Health Services Mobnity Study, perhaps now 
you can see the rational appeal of litigation under Title VII as a prod to 
reform. Unfortunately, litigation is occurring not an the precions few areas 
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where research has outpaced c (j.tijues neet :d : imprement it, biut ratheniin 
areas where rescc.^ch has noa yi„: . icovere:. sigtiincaaii.dimensions of coinire- 
tent performance— specifically inching c irrL licnool administration. This is 
unfortunate, beca use under the ^ua of li .ga^io at- the present iLime in the 
area of teaching and school :_;™iistrat!. the snius quo might be rein- 
forced or make-do. hastily cjni^ceiwed ai: ^mzntive; may be adopted. Both 
possibOiiies woulc reduce the c^^Tiamd for :nd im^-iniemt in soiund research- 
not to mention undermining cc; iidence t the '^IFI: : nnovement and possibly 
undoing what has peen accomp' ;. hed. 

In the meannme what is . o be dorae we imvflii research findings to 
support educationa-i policies? 

1 . What ziiQ reasonable siid affaTdnbi: n-ninri alternatives to curr^t 
practicss which do have an iirr.'pact upon populatirons 
protecsisi by the Civil Rights A ur. iin^d pizractices which are other- 
wise comtrary to our desires for lUStiice amid improving the quaiJity 
of education? 

2. Wliat aire reasonable mteiim me; isures far evaluating compet'^ncy- 
based teuchereducatHin prograjr.i^;.' 

3. What are reasonable interim mvims fo r e'v-:!luiatinii candidates for 
teaching positions and teacher'psrfonTEancei? 

These are imposing policy questions which you ccimfrocnt, anid, hopefuUy, we 
can begin to address them and uneartli others orver tine course of this con- 
ference. 
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FEEPORTTDF THE SPECIALXiEGArL ISSUES 



CONFERENCE OF THE MULTI-STATE CONSORTIUM 
ON PERFORIMANCE-BA5ED TEACHER EDUCATION 

By Sheila Buff 

Introduction 

AlthougTi it is 'not obvious from our afriliationi:^, the consultants ■ 'ii tl: e 
panel, together with Paul Olson, have been working informally over r^''^- paai 
year following research directions recommtended by the Study ConniLiission 
on Undergraduate Education and the Educatiain of Teachers directed by PaaiL 
Olson. David White, Svlaff Attorney witm the Childhood and Govejimment 
Project at Berkeley, hias made important contributions to these efforts. 
Unfortunately, he waL unable to join iin Denver, Together we are in the 
process of developing a proposal to estabziLili :an insinitute which would exam^ 
Lne occupational licensing, professional rjsrnrfication and related issues. We: 
looked upon this conference as an opporruniny to ssiare some of our thinking: 
to date on these issues and to begin cianafyimg tlie [^larameters of ou insti- 
tute's inquiries with the assistance ofrthe ccmference participants, 

Mthough the plamned. institute would niot lirmit itself to an expkniatioir 
of licensing in the tesichiriE: profession, it is an excellent place to bcgiin our 
vrork. Among occupations, employment practices redating to school person- 
nel seem to be front and center in the arena of the courts, and tisK compe- 
tency-based teacher education movement reflects a strong comnmiment to 
re-examine standards of professional preparation and .certification, moreover, 
whatever clarity.. depth and hreadth of understamding imjglu ac;lH:w»ve with 
respect to teacher licensing should have sigrHiScast bcainxig upon xnsimg in 
other areas which face comparable problems- 
Attending the conference were staff members of state deps" '.r^niu of 
edacation teach:3r certification departments, teacher union reprsEmt^izmtes, 
faculty of schools of education, members oi liie research and iie\"?Htr^CTsni 
community, legal counsel to state departmesis tBf edaicatii^r kwu^^i; lepxjr'- 
seniing the interests of parents and student.-;s:rii:n Oiinay'ivjfi.mdiivdQi^lj wiilh 
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a ssake in decisions regarding the teaching profession. They came to the con- 
ference seeking a better understanding of the implications of Title VlI,Qvil 
Rights Act of 1964, far competency-based leacher education (CBTE) and 
certification. We came wishing to share information and ideas amd to deter- 
mine whether the policy questions we considered important to address were 
likewise considered important by the participants. That we diid not have 
ready answers to all the policy questions the participants and we, ourselves, 
raised produced some frustration o\n both sides. Nevertheless, all agreed th.e 
time was well spent and much was learned all around. 

This report is an atteraipt to articulaie the questions and to capture ihe 
rich dialogue of the conference so that it may be shared with interested 
parties not in attendance. For the consultant panel and participants, the: 
report represents a point of departure. We: now have a clearer understamsang 
of the policy questions surrounding competency-based teacher educadcaiiand 
a better understanding of the context in which they will be answered. Deweii- 
oping sound answers to piolicy questions raised at Denver will, we hope, fctom 
the agenda of future joimt meetings of educational decssion-makers, Ismy^xs^ 
researchers, policy analysts, teacher representatives and educators. 

Conference Moderator: Paul Olson, Director, Study Commissioa cm Un- 

dergraduate Education and the Eii:;Wi'iv;j^tixiti^» 
of Teachers 

Conference Coordinator: Betty JLevitov, Study Commission on Umde?- 

graduate Education artd the Educatioin of 
Teachers 

Consultant Panel: Mny Freeman, Director, Teadner Hducafe-m 

Program Approval, Illinois Office of Eduw,- 

tion, Springfield, Illinois 
Sneila Huff, Research Feilow, EciJucat^<Dnal' 

Policy Research Center. Syracuse Restisn^i 

Corporation, Syracuse, New y^rk 
Paul Pottinger, Directar, linstituite for Cozn.p^ 

tence Assessment, McBer & Co., Bostce^. 

Massachusetts 
Michael Rebell, Attoirney, Rebell, Krirssci 

Fischbein & OLivieri, Attoimeys atliaw, Nevv 

York, New York 
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I. CONTEXTUAL SKETCH OF CBTE MOVEMENT 
AND QUESTIOI^^S GENERATED 



Most of the discussion of featnnes of the CBTE context arose during 
the course of the conference as fragm^snted, elliptical comments. Because of 
the importance of understanding ihe context within which policy issues 
relating to CBTE will be resolved, the author of the report has expanded 
somewhat upon items from the oriigimal discussion in Part I. Time did not 
permit further elaboration. 

The Accountability Movement 

The accountability movement nnay be viewed as the contemporary 
translation of concerns for social justice^ for quality, and for efficient and 
effective management in the daimain of education. The primary intent of 
accountability legislation is to assess thie outcomes of schooling in relation to 
public resources allocated to education. 

In a detailed analysis of the accountability movement as of 1973, 
Maureen Webster notes that tLie push for accountability is growing and 
creating changes in the context for decisions about educational policy. She 
attributes this development to several trends of the 1960's: 

-The provision of virtually univ^srsal public schooling through 
high school allows amd impels an increasing shift in attention 
from responsibility foir access to ichooling to responsibility for its 
outcomes. 

—Massive federal involveiment in ectucation has contributed to rising 
expectations and increasing awareness of disadvantage on the part 
of those with substandard schooling. 

—The ambivalence of several major publicized evaluations of the 
impact of massive subsidiization iias eroded confidence that laige 
infusions of tax dollars will resui-t in substantial improvements in 
the measured performance of schooling. 

—The costs of schooling are increasing together with the resistance 
of taxpayers to the rising curve of expenditures on education.^ 

According to the 1974 figures of the Cooperative Accountability 
Project: 
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-1 8 states had enacted accountabilhy legislation pertaining to state 
testing programs, 

-16 states had enacted accountability legislation pertaining to 
management systems, 

-13 states had enacted accountability legislation pertaining to 
professional school personnel evaluation, 

-2 states had enacted accountability legislation pertaining to 
performance contracting, and 

-^3 states had enacted accountability legislation relating to per- 
formance-based school accreditation. 

Most of the states enacted legislation under several of these categories. 
In total between 1963 and 1974 thirty states had enacted seventy-three laws 
containing approaches to accountability. 

The first wave of accountability legislation related to statewide testing/ 
assessment of student performance. It deals at varying levels of specificity 
with what is to be evaluated, at what level, with what target groups, when, 
and how. Webster poiuts out that whereas in the past testing was used primar- 
ily fjr the guidance of students, contemporary accountability legislation 
emphasizes a different primary function for testing programs which is the 
furnishing of information for state-level decisions about the adequacy of 
schooling. The second wave of accountability le^slation involved the evalua- 
tion of professional school personnel, with thirteen states having such provi- 
sions as of 1974. 

Since the idea of relating pupil outcomes to teacher performance has 
considerable force and tenacity, the fear among professional school person- 
nel is that test scores of students will be misused for evaluation purposes and 
teachers and administrators unfairly blamed for poor performance of 
students. 

Accountability pressures, coupled with the traditional concern of state 
education department officials for improving the quality of the teaching 
force, led the conference participants to ask themselves and the consultants: 

1 . How can the performance of teachers be more fairly, legally, and 
adequately evaluated? or How should one evaluate teacher compe- 
tence? (Policy questions are italicized and numbered consecutively 
throughout Part I. They are of the form: "What should we do?" 
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CBTE as Institutional Accountability- 
State Education Department officials are expected to administer the 
broad policies contained in statutes, regulations, and the directives of legisla- 
tures, state boards of education, and chief state school officers. Broad policies 
must be converted into specific regulations. A reasonable hypothesis is that 
state policies of promoting, encouraging, or compelling the adoption of a 
competency-based model by teacher preparation programs have arisen in the 
course of converting broad accountability directives into specific state educa- 
tion department policies. 

Educational accountability, broadly construed, calls for an examination 
of all aspects of the system— f/ze goals of schooling, pupil outcomes, teacher 
performance, the objectives of teacher preparation programs, admissions and 
evaluation standards of teacher preparation programs, certification standards, 
the allocation and utilization of resources, the utilization of R&D findings, 
etc. Ideally, designing and obtaining approval for a particular CBTE program 
forces an examination of these and other factors and an explicit reporting of 
decisions and plans deriving from these considerations. These formal state- 
ments, which are the basis of program acceptability "as CBTE programs" in 
several states, set the stage for accountability of teacher training institutions. 

Many questions were generated in focusing on this aspect of the 
context of CBTE. A second pressing policy question which emerged at the 
conference was: 

2. How might the states best assure quality teacher preparation programs? 
Related questions are: 

3. Does more accountability indeed lead to better program quality? 

4. Might these agreements between state education departments and edu- 
cational institutions (program approval) be treated like contracts, and: 

a. If an institution does not *honor its commitments,' can the state 
put it out of business, and would the courts back up the state? 

b. Might a former graduate sue the institution for failure to prepare 
him/her as agreed? 
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c. Might a school district sue an institution for recommending the 
credentialling of an inept student? and 

d. Might a student taught by a graduate of a CBTE institution sue 
the state for allowing that institution to certify an incompetent 
teacher? 

5. Can agreements be treated as contracts in the absence of empirical 
validation of standards for determining institutional performance? 

CBTE as Rational Management 

Another interesting aspect of the context of CBTE is the current inten- 
sity of the trend toward greater and greater rationalization of work processes 
—a trend with us since the earliest stages of the industrial revolution.^ CBTE, 
the rational equivalent at the institutional or program level of behavioral 
objectives at the classroom level, reflects this trend. 'Management by object- 
ives,' first used in the business community, is now a household term in certain 
educational circles. A close look at what is involved in an institution's adop- 
tion of the competency-based education mode reveals its debt to 'manage- 
ment by objectives' and other management models such as Planning— Pro- 
gramming-Budgeting System (PPBS), Uniform Accounting System (UAS), 
and Management Information System (MIS).^ 

Hand in hand with intensive rationalization is the demand CBTE places 
upon the scientific community. There are calls for new and improved mea- 
surement instruments; research on learning of adults as well as children, 
research on dimensions of competent performance, and so forth. Educators 
want to be absolutely clear about what they are doing, and to be assured 
that what they are doing represents the best of practice as scientifically con- 
firmed. 

The demand for research and development findings in these domains 
far outpaces the supply, and there is no assurance whatsoever that the level of 
funding of this research and development will be increased. Furthermore, 
there is no assurance that the research and development effort in demand 
would be coherently organized and effectively coordinated to assur ^ its 
quality and relevance were adequate funds available. 
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The other side of this coin is a crisis of confidence in the judgment of 
those traditionally counted as educational experts. Policy -makers who depend 
upon experts for advice seem to be saying "We must await scientific confir- 
mation before holding forth any conviction about what we are requiring or 
what we are doing." 

Accompanying crises in confidence are challenges to the authority of 
professional educators and policy-makers to decide: (a) what the schools 
should be teaching, (b) in some cases, the manner in which it will be taught, 
and (c) the criteria that will be used to select and evaluate school personnel. 
Federal and state agencies have begun, over the past decade, to stipulate the 
institutipn of parent advisory councils as a condition of funding and to 
demand their 'meaningful participation' in educational decision-making at the 
elementary and secondary level. Also, due perhaps to unionization, classroom 
teachers are increasingly involved in state-level educational policy decisions. 

Although 'involvement' and 'meaningful participation' does not mean 
control, it does represent entry and influence in the domain of traditional 
policy-makers and their advisors, and some perceive this as a first step toward 
community or union control of the schools. Some conference participants 
hailed this possible development as the best means available to improve the 
quality of schooling. Others damned it as a development that could destroy 
the public school system. Whatever the attitude, it was considered a signifi- 
cant development to be taken into account in CBTE planning. 

In keeping with this trend toward broadening the cast of educational 
decision-makers, participation of parents and teachers has a place in the plan- 
ning of CBTE programs in several states. Questions about the legality and 
advisability of this participation arose together with bther questions deaUng 
with the highly rationalised nature of CBTE, the lack of an adequate scien- 
tific foundation, and the crisis of confidence in experts: 

6. Does a more highly rationalized process lead to a qualitatively better 
product? Specifically, do the activities generated by converting to 
CBTE enhance the probability of developing teacher preparation pro- 
grams of better quality? 

7. Are unrealistic expectations being placed upon the scientific commun- 
ity? Might CBTE be construed as 'false advertising' or 'fraud' in the 
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absence of a sound scientific basis for requirements? Could we (state 
education departments) be sued? 

8. Until the scientific community meets the expectations of CBTE (or 
comes closer, or gives up), \\;hat ndes should govern judgments involved 
■in educational decision-making? What would be the criteria for trust- 
worthy evidence? 

9. How have research findings entered into policy decisions in CBTE? 
What should be the place of such findings in CBTE policy decisions? 

10. Wliat is the basis of state authority in educational decision-making? 
What should be the basis of state authority to maximize the probability 
of improving the quality of schooling and the preparation of teachers? 

11. How has authority over educational decisions been delegated in the 
states? How might the authority structure be revised or resuscitated to 
maximize the probability of improving the quality of schooling and 
teacher preparation ? 

12. Is the crisis in confidence in the judgment of traditional experts justi- 
fied? \^hat should be the role of traditional experts in CBTE decision- 
making? How much weight should be given to their judgments? 

1 3 . What educational decisions should parents, community representatives, 
teachers, and students influence? Which shouki they control? What has 
been their role in CBTE decision-making? What should be their role in 
CBTE decision-making? 



Cultural Pluralism 

Another important aspect of the context of CBTE are dilemmas of cul- 
tural pluralism. Insofar as the goals of public schooling are anchors of CBTE, 
and insofar as goals are very much up in the air and the subject of contro- 
versy, CBTE is not secure in its moorings. Definitions of competence derive 
from conceptions of practice. We are in a period of rather intensive reexam- 
ination of the aims of education. The old metaphor of the melting pot as an 
ideal is being reconsidered, and we wonder how cultural diversity might 
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coexist with certain commonalities in education that enable people to cooper- 
ate in building a better society and a better world. Recognition of these 
societal tensions generated some difficult questions: 

14. //ow do we cope with ever-changing sets of educational goals? What dp 
we do when various groups cannot agree on a set of goals? How much 
homage is to t>e paid to articulated goals of schooling in preparing 
teachers? 

15. How do we fit various prescriptions for dealing with cultural diversity 
into CBTE? Who has authority with respect to goals? How should we 
make the tradeoffs between general and culturally specific training and 
licensing? 

16. What would be the characteristics of an ideal licensing system that 
would fit a schooling system which provided a common education as a 
core and a broad range of options beyond the core to accommodate 
cultural diversity and special interests? What should be handled through 
local hiring and promotion practices, and what should be relegated^ tee- 
the domain of teacher licensing? WIm would the staters role be with 
regard to local hiring practices? How should 'relicensing* or in-service 
evaluation interrelate wth local prerogatives? 

^ CBTE and Fair Employment Practices 

Last but not least -and probably foremost— in our examination of the 
context of CBTE is Title VH of the Civil Rights Act. ' 

Somehow, somewhere, thoughtful people concluded that inequalities 
of employment opportunities in the United States were not necessarily the 
result of intent to discriminate against particular populations. Rather, built 
into the very fabric of institutions or practices affecting employment selec- 
tion were rules, processes, structures and standards which, as they legiti- 
mately or inevitably discriminated, did so disproportionately with respect to 
particular populations such as minorities and women.^ Insofar as these could 
be justified~in particular cases—in terms of the requirements of adequate job 
performance, they were deemed rational, fair, justifiable, 'a matter of busi- 
ness necessity,' and therefore, allowable. Insofar as they could not be so 

131 



140 



justified, they were deemed instances of 'institutional racism' or 'institutional 
sexism.' 'xhose responsible for imposing these rules, processes, structures and 
standards were to be held accountable for their (unjustifiable) adverse impact 
uPon minority populations and women, despite the absence of any intent to 
injure these populations. Thoughtlessness or ignorance would not remove the 
t?Urden of responsibility. 

Of course, once those imposing these rules, processes, structures and 
5tandards understand that they operate to discriminate unjustifiably, continu- 
ation of these institutions or practices would no longer count as 'uninten- 
tional injury.' 

One can readily see how difficult it would be to sort out the innocent 
fioin the guilty and how this difficulty might lead one to refuse to acknowl- 
edge difference s>>which is the course that has been taken by the U.S. Equal 
Employment Opportunity Commission (EEOC) in its Guidelines on Em- 
ployee Procedures. ^ 

The making of such a distinction (between intent or no intent to dis- 
criminate) on the' part of the courts has not been the usual experience of 
employers who have been involved in Title VII Utigation, Absent a finding 
either way, employers who could not demonstrate the job-relatedness of 
certain employment practices which resulted in 'adverse impact' on popula- 
tions protected by Title VII have been required by the courts to pay damages 
and otherwise make compensatory adjustments. 

An interesting post-conference development, in a case where discrimi- 
natory intent had not been estabUshed, is that an employer was held liable 
for damages to a man whose promotion, after an out-of-court Title VII 
settlement, was 'adjusted,* Daniel McAleer, an AT&T employee, was bypassed 
in a promotion decision. To make amends for past adverse effects of promo- 
tion procedures and policies (AT&T never admitted to an intent to discrimi- 
nate), AT&T promoted, instead, a woman with a lower performance rating 
and less seniority.^ The logic of the courts decision in this case was that 
'^since McAleer had no responsibUity for AT&T's past sex discrimination, it is 
AT&T rather than McAleer who should bear the principle burden of rectify- 
ing the company's previous faUure to comply with the Civil Rights Act of 
1964 An affirmative award of some damages on a 'rough justice' basis is 
therefore required and will constitute an added cost which the stockholders 
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of AT&T must bear."^ 



At the time of the conferencf5 in Denver, the hwer courts, in deferring 
to the EEOC Guidelines, were acknowledging the precedent established by 
the Supreme Court in Griggs v. Duke Power Company (401 U.S. 424, 1971) 
not only in cases brought under Title VII, but in cases brought under the 
Constitution's due process guarantee and other provisions such as the Civil 
lights Act of 1866. On. June 7, 1976, the Supreme Court, in a 7 to 2 deci- 
sion,^ ^ ruled that in cases not brought under Title VII of the Civil Rights 
Act, to prove a violation of the Constitution's ban against racial discrimina- 
tion, the Court must prove 'racially discriminatory purpose' in addition to a 
'substantially disproportionate' burden on one race of particular employment 
practices. "The court found essentially that the rules for Title 7 cases did not 
apply to these other provisions."^ ^ 

From these and other developments it may be concluded that the legal 
context of CBTE is, at the moment, somewhat unpredictable. 

It was primarily a concern with the implications of Title VII for state 
education department activities relating to CBTE that brought us together at 
Denver. There have already been suits involving educational employment 
decisions in several states, and there is every indication of more to come. 
Participants wondered if they could be sued, for what precisely, how they 
might defend themselves, and how they might prevail against the likelihood 
of such suits. Their questions included the following: 

17. Would or could Title VII be applied to teacher licensing? Isn't it appli- 
cable only to hiring and other employment practices-the province of 
school districts rather than state education departments? 

18. We cannot yet establish predictive validity for the measures used in 
teacher certification, and predictive validity is preferred by the EEOC 
Guidelines. Would the courts be content with a demonstration of 
content validity? 

19. How might we go about content validation that would satisfy a court? 

20. Absent a demonstration even of content validity, would the courts 
settle for a democratic process involving parents, teachers and students 
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in arriving at standards for teacher certification? 

21. Among the professions, is teacher licensing in a less tenuous position 
with respect to the EEOC guidelines than other areas of professional 
licensing? (the answer was 'no.') 

22. Wliat sort of snares does the program approval approach to teacher 
licensing hold with respect to Title VII? 

23. Given the absence of a scientific foundation forjudging the adequacy 
of CBTE programs, what might be the legal ramifications of a state's 
not approving or withdrawing approval from a CBTE program? What 
kind of evidence could or should one use for a program approval 
process which would permit one to say 'no' to an institution on some 
legitimate basis. 

24. Wliere, legally, is a teacher training institution if it should refuse to 
certify an individual? 

25. What should be the foundations of an appeal process where students 
might challenge an institution's or a state's decision not to certify 
them? 

26. What rights do teacher preparation programs have with respect to state 
departments of education? Can they reject the CBTE model or aspects 
of it? How would the courts deal with such a situation? 

27. Where would a state stand, legally, if it ordered the dismissal of a 
teacher in good standing considered coniyeteiii-due to some error in the 
issuance of a provisional or permanent liiccnsc? For example, if it were 
discovered that the teacher had not takemalinof the courses required in 
the state for certification? 

28. What would an ideal certification system look like: 

a. given current limitations in scientific knowledge, 

b. given an ideal level of scientific knowledge? 

29. Subject matter mastery has face validity as a prerequisite to licensing. 
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Would the courts accept subject matter mastery tests based on careful 
job analyses? 

Supposing the goals of education for elementary and secondary schools 
of a region/locale/state were taken into account in establishing licensing 
requirements, how could we keep apace of changes? How should goals 
of education be taken into account in program planning and program 
approval? 

What should be the role of the research community in educational 
policy decisions? How should v e treat research findings? VJhat do we 
do when researchers disagree o/ tell us the *n ' was not large enough to 
reach a definite conclusion? "How large an 'n' do you people need 
anyway?" 

What has Title VII done to the definition of "policy"? It used to be the 
case that if a person in authority in the educational system said some- 
thing was necessary, it was policy, and it was not questioned by the 
courts. 

What do we do when what is do-able, feasible, is in iconflic: with the 
way wc believe things sJmzdd be done? What should we ^ now to 
assure that we are not fcmcclosinir on the options of *besz^ licensing 
systems? 

State authority in most case" is atithe initial entry level into^teaching. 
With declining enroUmentsiiand very little turnover in the teaching 
force, is not the real issue i^aw to make the present work force more 
competent? Should we apprcmch the problem of school personnel eval- 
uation through technical assistance to local districts, a second-tier of 
certification, relicensing? Should pressures be put on schools of educa- 
tion to focus upon in-service training? 

What are the primary sources of potential challenge to credentials? 
What should our priorities be in making our systems as rational and fair 
as possible? Should we set priorities in accordance with the order of 
vulnerability? 

When a state legislature passes a law that bilingual, environmental 
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protection and conservation programs will be instituted in the schools, 
what are the obligations of state education department officials in 
charge of teacher certification? The teachers we are licensing will not 
necessarily teach in our state. There will be teachers coming to our state 
from elsewhere. How should this be handled? 

37. Some states have renewal-of-Hcenses cycles ^nd standards that are not 
being enforced. Should they be enforced? How? What are the obsta- 
cles? How might they be overcome? 

38. What should we do about the *good moral character' prerequisites for 
licensing? (The answer was 'Sve need another conference to address 
that.*') 

The number and coiiijplexity of tsm^ questions-especially the psalicy 
questions-should be enough to cDnvince the reader that they couM 
dealt wifeiin only the most cursory/ maimer in the few hours at our dismsal. 
All of them are serious and deserviag oifrthsrmost careful attention. What fol- 
lows is £:a attempt to capture thezessemce of discussions relevant to mcsst of 
the quemons. Some of it is uifomazion which stands on its own. 5ome 
of it represents tentative suggestions, idi^as, opinions, attitudes, perspectsves- 
all meantto be helpful, but far fromrtheJinai word on the issues raised. 
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II. DISCUSSION 



•Rational* V. Rational: 'Empirical' v. Empirical: 
and the Courts v. The Research Community 

At some point during the conference, after a period of talking past one 
another, Thomas Green (Syracuse University) pointed out that tJie research- 
ers, lawyers and state officials present were bogged down in contending 
notions of 'rationality.' From a contextual analysis of the EEOC's Guide- 
lines, one may conclude that its authors construe 'rationality,' as it applies 
to employment decisions, as 'proceeding according to the rules of scientific 
inquiry/ The EEOC specifies the particular rules of scientific inquiry to be 
followed in developing and validating assessment devices. The procedures are 
rigorous and systematit. 

On the otksr hand, our ordinary language understanding of 'rational- 
ity,' and that generally shared by policy -makers, is reasonableness or good 
judgment in light of available evidence. In most situations, we do not insist 
upon systematically vigorous standards of confirmation in deciding whether 
an action is or is not rational. 

As noted in Rebell's paper, the treatment of the concept of 'ration- 
ality' by the courts is complex and relevant to the issues under^discussion at 
the conference. The courts have traditionally distinguished becween those 
types of claims which would receive 'strict scrutiny' (generaily^ses involv- 
ing certain categories of victims such as racial. .minonfy groups, or ^certain 
'fundamental interests' such as voting rights) and all other cases which the 
court would review in a perfunctory fashion. 

In the case of 'strict scrutiny,' the state would have to show that the 
challenged law or practice was absolutely necessary, that there was no other 
way to accomplish the result. In cases not receiving 'strict scrutiny,' the 
courts would invalidate a state statute or action only if there was no possible 
rational relationship shown between the statui^ie or action aiid any ooticeiv- 
aWe legitimate goal or purpose. Rebell pointed out that in recent years this 
dichotomy between 'strict scrutiny' and rational relationship analysis has 
begun to break down, and a middleiground of analysis is emerging. In several 
cases, in applying the 'rational relationship test,' the courts undertook a sub- 
stantive rather than a perfunctory analysis and held that the requrements 
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being challenged were not substantially related to the purpose for which ihey 
existed. The courts, in other words, 'revitalized' the traditional rational 
relationship approach and gave it some bite. 

It was concluded that it is important to take cnto account these differ- 
ing treatments of 'rationality' in order to avoid ambiguity. 

Some additional confusion in the discussion stemmed from difficulty 
with the concept 'empirical.' The scientific community restricts its usage to 
propositions confirmed in accordance with rigorous scientific procedures— a 
special class of experience; whereas the ordinary language understanding of 
'empirical' is 'based on any kind of experience.' In other words, standards of 
confirmation differ. 

It was noted that the EEOC Guidelines, then, may be viewed as an 
attempt to change the concept of 'rationality' in the courts with respect to 
Title VII issues (through changing the standards of scrutiny and confirma- 
tion)-to base the concept more upon empirical evidence derived from 
systematic, rigorous inquiry and less upon empirical evidence fromi ordinary 
experience. iTiat is, with regard to employment selection devices, where 
theii use results in adverse impact upon populations protected by Title VII 
of the Civil Rights Act of 1964, there is a requirement for a clear showing of 
'job-relatedness.' 

As pointed out in Michael Rebell's paper, "Validation under the EEOC 
Guidelines is described under two main headings: 'predictive validation' and 
'content validation.' Predictive validation is the higher standard, which is 
normally required of all employers " After briefly outlimng whait i& in- 
volved in predictive validation, he points out that '^Although pn^dictivc 
validation is the preferred standard and is required generally in cases inTOlv- 
ing private companies, in many of the public sector cases which have arisen, 
the courts have invoked a clause in the EEOC Guidelines which pecmitsithe 
use of 'content validation' where predictive validation is preserrtly ^ot 
feasible.' " 

In his paper, Rebell also explains developments in the courts which lead 
him to expect that in cases involving challenges to teacher licensing practices 
-even if not brought under Title Vll-the courts will invoke the EEOC 
Guidelines in looking for a rational relationship between the requiremeats 
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of performance as a teacher and the prerequisites of licensure. 

Given the following circumstances, his prognosis is that the courts 
would be satisfied with a showing that tests or other criteria in use have been 
content validated by carefully conducted job analyses: 

(a) It is possible to show adverse discriminatory ijnpact of selection 

devices in almost any particular case brought before the courts 

(therefore, states can expeci the burden of proof to be on their 

side in challenges brouglit under Title VII); and, CBTE not- 
1 3 

withstanding. 

(b) It is not possible at present to demonstrate predictive validity 
for any of the selection devices in use. 

(c) No alternative selection devices with greater predictive validity 
and less discriminatory impact are available to substitute. 

(d) There is currently no body of scientific data upon wliich to con- 
struct tests with greater predictive validity. 

Rebell recommended close attention to two New York City cases. Chance v. 
Board of Examiners^^ and R-ubinns v. B^^^ji^rd of Examiners^ ^ -invoWmg an 
additional level of certificatnon-c^or ifi-ijij^i^its into how the courts might 
respond in challenges to state^school personnel licensure requirements or pro- 
cedures. He suggested that for licensure purposes, under the circumstances, 
subject matter tests based on job analyses would have face validity and 
would probably impress the court. Fred McDonald interjected that studies 
conducted by ETS revealed that for all its face validity, subject matter 
mastery explained only 7 per cent of the variance in teacher performance as 
measured by pupil outcomes. 

This point brought to feht one rationale behind resistance to minimal 
licensure based on subject-nianter mastery tests. That is, in addition to /cnmv- 
ing about what one teaches, people want assurance that teachers knov^ how 
to teach others what they know. Apparently, it is thouglit that some profi- 
ciency with some methods— even thodgli one cannot demonstrate which are 
most effective -is preferable to no training or no proficiency with any 
methods. The 'approved program' approach to licensure assures, at minimum, 
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exposure to some methodologies of teaching, if not proficiency. Sharpening 
assessment procedures in schools of education is one way in which CBTE 
hopes to improve the likeHhood of greater proficiency. Tlie frustration, of 
course, lies in the doubt that the proficiencies promoted are significantly 
related to teacher effectiveness.^^ This theme of doubt pervaded the dis- 
cussions. 

Apart from the insufficiency of subject matter mastery for licensure or 
hiring, it is, to be sure, a necessary component of teacher competence, and 
subject matter mastery tests are used extensively as screening devices. Rebell's 
point was that the courts would, in all likelihood, insist upon a showing of 
rational relationship between the subject matter of tests or program require- 
ments and the area of teaching for which teachers are being licensed. One 
basic step in demonstrating rational relationship is to conduct thorough job 
analyses-the key to acceptable content validation. In his paper, drawing 
upon his experience in Chance and /?w6/rto5 cases, he sets forth key compon- 
ents of a valid job analysis. Summarizing from his paper, they are: 

(a) The specific job areas should be clearly defined yet not atomis- 
tic. (Paul Pottinger's paper gives insights into how one might 
avoid undue fragmentation.) 

(b) A representative cross-section of persons who have an interest in 
the selection or evaluation process must have input into the job 
analysis. (Tlie job cannot be defined exclusively from the per- 
spective of present job holders because of upgrading and updating 
responsibilities.) 

(c) In the case of regional or local licensing in addition to state licens- 
ing (as in New York City and Buffalo, New York), local needs 
should be taken into account by including the perceptions of 
local policy-makers as well as the 'traditional' employer (e.g., 
principals, parent advisory councils, etc., as well as superinten- 
dents and state officials). 

(d) The use of independent outside consultants to undertake the job 
analysis to prevent monopolization of the process by people ^Aath 
vested interests in particular outcomes. 

With regard to possible court challenges, Paul Pottinger pointed out 
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that most of the examinations that were in use were not based on job 
analyses. They were not content validated. The participants asked Pottinger 
and Rebell if they would outline how to go about thorough job analyses that 
would pass muster in the courts. Since procedures for conducting job analyses 
are technical, there simply was not time at the conference to provide a sketch 
of what is involved. As well as techniques the participants wanted: (a) esti- 
mates of the ^?0St5 that might be involved, (b) ideas on how they might cope 
Willi bllilll{}lllB ll^t»llS and goals, and (c) information that would help them in 
deciding what should be the province of state licensing at the entry level to 
the profession and what should be the province of local hiring or possibly a 
second level of state certification. In other words, it seemed to the partici- 
pants that conducting job analyses might be a good idea. 

Paul Pottinger registered some reservations in this regard, however. He 
questioned the wisdom of investing in job analyses without empirical evi- 
dence supporting their validity. To simply determine that tests are related 
to job analyses without evaluation of the validity of the job analyses, them- 
selves, provides a tautological system which may satisfy the courts' demand 
for due process but not the scientific demand for better knowledge of what 
works and why. Since content valid tests are only as good as the job descrip- 
tions, attention to the validity of job function analyses must be given higher 
priority if licensing tests are to be relevant to competence and not merely 
relevant to rational or due process criteria. 

In his paper he pointed out that only construct validation-constructs 
being tied to competent performance as measured by carefully controlled 
pupil outcome studies^ -would sort out effective from ineffective practices; 
and "is that not, after all, the work at hand if the goal of CBTE is to improve 
the quality of schooling?" Money and time invested in job analyses would 
drain funds and attention away from critical basic research on teacher cffect- 
iveness-an already grossly underfunded domain of inquiry. Further, he urged 
against employing the energies of the CBTE movement in playing a 'catch-up 
game* with the courts. He recommended a 'proactive' rather than 'reactive' 
stance with best energies being devoted to developing methods of arriving at 
sound answers to the questions CBTE raises. 

A state education department official suggested a compromise: support 
basic research in teacher effectiveness through enlisting congressional support 
for NIE's projects in this area. In the interim-which may be decades- 
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proceed with job analyses beginning where they seem to be most needed. 
Pottinger noted that adequate technology for conducting job analyses aheady 
exists which goes a long way toward meeting both the demands of the courts 
for due process and the demands of metliodologists for constructing valid 
job descriptions. However, no consensus was achieved on next steps to be 
taken. 

"What," it was asked, ''might be the courts' reaction if requirements 
could not be backed up by systematic job analyses let alone carefully con- 
trolled research siudies on effective and ineffective practices?" Although the 
defendants would be in a very tenuous position in light of developments 
reported in his paper, Michael Rebe.U's response appealed, again, to the 
courts* construal of 'rationality': 

(a) Was the matter of requirements given the careful attention of 
individuals the courts would acknowledge as experts? 

(b) Can the state education department produce rational arguments 
in support of the requirements at issue? 

(c) Were the decision procedures for deciding fair, with the interests 
of groups affected by the decision taken adequately into ac- 
count? 

(d) Were there established, operable procedures and guidelines for 
appeals? 

These, he suggested, were the kinds of things to which a judge would pay 
careful attention in arriving at a decision. 

Participants wanted to know how they could prevent suits. Needless 
to say, the answer was "Theie is no way to prevent being sued." However, 
it was suggested that time spent doing the following might very well reduce 
the incidence of suits and the risk of defeats: 

(a) analyzing requirements-revising them where insupportable and 
substantiating them where reasonable in Ught of currently avail- 
able evidence ('best eviaence' being from job analyses), 
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(b) examining and improving decision-making processes, and 

(c) revitaUzing or estabUshing sound appeals Procedures which 
eUminate occasions where injuries to parties may be attnbuted to 
inational, teclinical requirements. 

As an example of what he considers a paradigm of an irrational techni- 
cal requirement, RebeU offered the example of a current cUent of his who 
had been teaching chemistry for several years. He was dismissed from his 
position when it was discovered that he had net had the period of supervised 
practical teaching required under one (of two) ahernatives for Nev/. York City 
licensing (under the authority of the New York City Board of Examiners), hi 
order to qualify for the licensing examination, under Alternative A one had 
to have completed the required courses and a period of student teaching. 
Alternative B, to accommodate teacher shortages, waived the student teach- 
ing requirement 

In completing his examination application, Rebell's client inadvertantly 
checked Alternative A as the category of Ucensing. He took the examinations, 
passed, appeared on the Alternative A eUgibility list, was assigned to a school, 
served for three- years, had high performance ratings, and was recommended 
for tenure. A year or two later, in checking through the records, it was 
discovered that he was not eUgible under Alternative A to take the examina- 
tion and that his name should not have appeared on the eUgible Hst under 
Alternative A. He was informed that unless he could prove that he was eUgi- 
ble at the time, un^^i Alternative A, his license would be revoked. Of course, 
he could not because he had not fulfilled the Alternative A student teaching 
requirement. He should have checked Alternative B. His Ucense was revoked 
and he was dismissed from his job. 

Having exhausted other possible avenues for reversal of this decision 
and reinstatement in his job (that is, the appeals process through the New 
York City Board of Examiners and the New York State Comniisaoner's 
office), he appears to have no alternative but to sue in the federal courts-an 
alternative he simply cannot afford. 

We do not know what the outcome in tliis case will be -whether it will 
reach the courts, be satisfactorily resolved outside of the courts, or become 
another statistic in the accident record of irrational Ucensing and hiring prac- 
tices. 
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CBTE Planning 



Defining Competence 

The discussion then moved to CBTE planning. When a state decides to 
adopt the CBTE model, it must decide what, substantively, will be meant by 
'competence' fcr purposes of program approval and the certification of 
graduates. Tlie call is to create an Ideal type' concept of *the competent 
teacher' within specialized areas and in particular contexts. Unfortunately, as 
pointed out, the 'ideal type' construct cannot at present emerge from well- 
founded theories of effective practice. New York State had proclaimed that 
by 1990 it would. At the conference, a representative of the New York 
State Education Department said, *'That was an ideal, a goal, not a promise 
or a prediction." 

Given this lag in supportive research and other considerations brought 
out at the conference (for example, the pressures to deal more democrati- 
cally with issues of cultural pluralism and local needs), several states have 
opened up the planning process to a broad range of participants which have 
included community leaders, teachers, parents, and students in addition to 
traditionally recognized experts. Phase I of the process has typically culmi- 
nated in the production of lists of competencies— some numbering in the 
thousands-which teachers should manifest. 

Many of the conference parucipants-^specially those representing the 
research community—took a dim view of these procedures as a means of 
establishing what teacher preparation programs should attempt to accom- 
plish and state education departments should certify. Better to rely on ex- 
perts. (For an argument against this position, see the section on The Courts' 
Perspective on CBTE Planning on the next page.) However, they agreed to the 
need for participation of these groups in establishing the goals of primary and 
secondary schooling. 

Delegation and State Interest 

Appropos of establishing the goals of schooling, someone asked what 
the 'state interest' was in such decisions. State constitutions, statutes, and 
commissioners' regulations frequently specify categories of curriculum for 
the schools. Furthermore, it was mentioned that if New Jersey is the begin- 
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ning of a trend, state laws will become increasingly specific about what com- 
prises a 'thorougli and efficient education' leaving even less room for maneu- 
verability than at present. 

Participants wondered how 'state interest' interrelates with CBTE pro- 
grams and processes-not simply on substantive grounds, but on procedural 
grounds, such as delegation of authority, as well, Michael Rebell pointed out 
that this had to be addressed on a state-by-state basis, since state constitu- 
tions and statutes differ. 

In most states, the constitution has not given the legislature all of the 
power in educational policy-making. Some powers have been given to consti- 
tutionally established boards of education and institutions of higher educa- 
tion. Some of the power of institutions or boards includes the preparation of 
teachers. For all states, it is apparent that constitutionally appointed bodies 
cannot do everything. Therefore, they have been given power to delegate 
policy-making and administrative authority. However, the constitutionally 
appointed body does retain ultimate control. 

In the case of CBTE planning, policy-making authority is often dele- 
gated to consortia of community' groups, higher education institutions, 
teachers, etc. with the hopes that the process will result in better standards 
for competency. Insofar as policy is decided at this level, it must be examined 
in light of delegation theory. Delegation to this lower level of authority and 
the widespread adoption of the 'approved programs' approach to certification 
mean that, in a classical legal sense, litigation becomes much more complex 
and problematic. 

In summary, depending upon authority structures and circumstances, 
delegation wiU or will not be legitimate. Consideration of delegation, when it 
involves Title VII and constitutional guarantees, will be very complicated. 
V/hoever retains delegated responsibility and authority will be challenged 
when standards are at issue. Each state will differ. 

The Courts' Perspective on CBTE Planning 

Michael Rebell was asked what view the courts miglit take on the 
aforementioned participatory CBTE planning process. He outlined some 
pragmatic considerations which might favorably dispose the courts to the 
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adoption of these procedures. To begin, he noted that rationality of the pro- 
cedures and legitimate delegation of authority would not obviate the proba- 
ble requirement of the courts that the deliberations of these consortia be 
firmly grounded upon information gleaned from carefully conducted job 
analyses (in the absence of predictive validations). He thought it likely that 
the courts would take into account the fact that there are few, if any, better 
alternatives open to the states at present. The major argument against the 
most popular one— continued exclusive reliance on traditional experts— mi^iy 
he suggested, go as follows: 

Where minority populations are concerned, considerable 
evidence can be amassed that points to the failure of tradi- 
tional experts to effectively deal with minority education. Much 
of the failure is attributed to a lack of awareness of cultural 
differences that generate special educational needs. Bilingual 
education programs and the community schools movement are 
responses to this failure. Opening up CBTE planning to broader 
participation that includes minority representation and represen- 
tation of teachers experienced in dealing with these populations 
may be viewed as another 'sensible,' timely' response to this 
failure. 

Further, insofar as all populations are concerned, a vital 
step in planning is setting goals. Since it is not self-evident that in 
a democratic state traditional education experts should monopol- 
ize this aspect of planning, including nonexperts in this capacity 
would, more likely than not, seem reasonable to the courts. 

On balance, Rebell's opinion was that: (a) sound arguments can be 
produced to support the participatory processes of CBTE planning, (b) these 
arguments would probably impress the courts, and (c) the major concern of 
state education departments should be to improve the empirical base upon 
which CBTE consortia develop policies-not simply to protect themselves 
in lawsuits, but in the interests of sound planning. 

Teacher Preparation Programs v. State Program Approval Offices 

As noted, it is sometimes the case that teacher preparation programs are 
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handed long inventories of unweiglited competencies drawn up by statewide 
consortia. These lists are supposed to serve as the foundation of program 
planning— policy upon which to formulate yet more specific policy. Even 
where the matter of defining competency is left to individual institutions to 
determine, they are sometimes required to arrive at their definitions througli 
local participatory consortia. Alone or en masse, in' planning CBTE programs, 
educational institutions are supposed to take a staggering number of factors 
into account (including their monetary resources and faculty talents), arrive 
at plans in short order, and live up to them. Several states have instituted 
CBTE goals, timetables, applications review schedules, and renewal cycles. 

The pace and magnitude of change, coupled with self-consciousness 
about the foundations of the CBTE movement, created acute concerns evi- 
dent in the questions of participants. It was asked if quality could possibly 
improve under these circumstances, to which someone responded that things 
could not be worse than in the past when there was almost no accountabil- 
ity. Unfortunately, as one participant pointed out, the innovation was not 
being piloted as a social experiment and carefully evaluated as such. There- 
fore, at present cnly impressionistic statements can be made about whether 
it }S indeed better or worse. One state education department official said that 
they realized that in the earliest phase of CBTE in their state, it could be that 
they would only achieve better accountability, bui that over time, they ex- 
pected that hard thinking and written commitments about what was to be 
accomplished would yield qualitatively better programs. 

As might be expected, one of the participants wished to know if a 
teacher preparation program could successfully sue the state if, in the judg- 
ment of its faculty and administration, the timeliness or requirements were 
inhibiting the delivery of quality education. Even before this question was 
asked, state department of education officials worried aloud about the legal 
grounds upon which they stood in disapproving CBTE or, for that matter, 
traditional programs. 

In the discussion following these questions, Michael Rebell reiterated 
Some of the laws that might come into play given this set of issues. Regard- 
ing an institution's suing the state, he reviewed the recent opinion of the 
Texas Attorney General (Opinion H-197, Januar>- A, 1974), which involved 
illegal delegation of legislative authority to adndnistrative officials. Rcbell 
said lhat although that opinion was specifically based on an analysis of 
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certain Texas statutes (the Attorney General ruled they did not permit the 
State Commissioner tc mandate that all teacher education programs in the 
state be competency-based), the framing of the issues in that situation leads 
to the broader question of whether a fundamental policy shift such as CBTE 
may be mandated by an administrative agency in the absence of detailed 
legislative authorization. 

He also mentioned possible legal challenges arising under the First 
Amendment to the Federal Constitution. "Conceivably, a school that, for 
whatever reason, does not want to accept a mandatory CBTE directive from a 
state education department might claim that mandatory CBTE inhibits the 
ability of the school and its individual faculty members to teach in the man- 
ner that they believe best suits their needs, their values and their purposes." 

In the case of states refusing to approve programs, the paitici pants 
wished to know what evidence, in the absence of scientifically derived evi- 
dence, would hold up in a court. Larry Freeman suggested that the processes 
of program approval deliberavion involve publicly appointed representatives 
of *the public interest in the education of teachers'— that doing so would 
give more *clout' to the decisions of program approval offices. Michael Rebell 
stressed the importance of due process in pio^^am disapproval deliberations- 
weighty decisions affecting the power of an institution to grant degrees or 
affecting the eligibility for certification of its graduates. He suggested that the 
adversary model of the courts might be most appropriate— testimony of 
faculty, students, supervising teachers, etc., as well as the usual testimony of 
'inspectors' from accrediting agencies and state education departments, being 
critical evidence to be evaluated in teaching such decisions. Records from 
such proceedings would be part of the state's evidence in the event of litiga- 
tion and would rest the state's case on a firm procedural foundation the 
courts would respect. Moreover, such care in proceedings would probably 
reduce the likelihood of suits. 

A participant pointed out that it was usually the factors of finances 
and personnel rather than carelessness or obstinacy which led to less than 
adequate procedures for such decisions. Litigation would be more costly, 
true, but improving processes would tax already overburdened budgets and 
staff. As Thomas Green put it, in the press of policy-making and administra- 
tion, what is rational, in one sense of 'rational,' may not be the best thing to 
do. Tliere are always values to be traded off-*justice as due process'* being 
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among them. The participants and consultants took this, among other frustra- 
tions, home with them. 

Licensing v. Employment Selection 

One of the participants commented that in liis state, given cutbacks in 
eruoUments and in school staff, instructors were teaching subject matter 
other than that over which they had been examined for certification and 
hiring, and that as cutbacks increased, this could become the rule rather than 
the Cy^ception. He wished to know what subject matter one tested for under 
such airrj>u»stHnces. Further, he suggested that the emphasis in CBTE on pre- 
svTT/tic irai.;un]p. aird r^ertification was perhaps misplaced— that ^ven a shrink- 
ir-cnfary ^if.a secondary education system, perhaps the emphasis of 
CB'i t shorjM bfr on in-service evaluation and training. This comment led to 
a ^ujVv : -.^s of complex questions. 

wart comted out that given a shift in emphasis, many of the most 
inipcstvvi qf;o5tions would remain the same. Tliere would still be a problem 
wim cri?cri..i '(br evaluation of teachers and the development of sound pedago- 
gies Ut enlv,. :e the likelihood of improving the performance of practicing 
teaciterL; and the legal problems would still involve Title VII as it applies to 
pronjo'^jn, tenure, seniority, dismissal, etc. The soundness of evaluation 
procedures and criteria has been scrutinized in several Title VII and related 
cases. 

Co.ir:idering what should be the province of licensing and what should 
be the province of employment practices generated three dilemmas: 

(1) the *mini-max dilemma' 

(2) the ^general v. specific dilemma' 

(3) the ^common culture v. subculture dilemma' 

The *Mini-Max Dilemma' 

"Are we certifying competent teachers, or not?" was one way the mini- 
max dilemma was stated. In recognition that theoretical knowledge of teach- 
ing is insufficient to skilled performance as a teacher, schools of education 
have incorporated into the curriculum short practice teaching periods where 
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novices are supposedly closely supervised by master teachers. The principle 
is sound, but there is widespread recognition of frequent failures of practice 
teaching to provide quality learning experiences for novices. Therefore, there 
is a general hesitancy to affirm that schools of education are certifying com- 
petence. This queasiness was reflected in questions of tlie participants. *'Can 
a district sue us for sending them a certified 'competent' teacher who proves 
to be quite incompetent?" "Can parents sue us for turning loose an incompe- 
tent teacher on their cliildren?" 

Because many educators do not believe that the short term of trial in 
student teaching is an adequate basis for certifying competence, some prefer 
it to be said that what schools of education are doing is ''maximizing the like- 
lihood that those who are certified to teach will prove competent to teach" 
or ''minimizing the likelihood of incompetence." That, of course, throws 
into question competency -hdiSi^d teacher certification at the entry level. 
Should it be a 'minimal' notion with tougher competency standards left to a 
later phase of certification? Michael Rebell advocated this approach-'mini- 
mum' being subject matter mastery at the entry level. He added that this, of 
course, would be unacceptable for reasons discussed earlier if not coupled 
with a sound system of on-the-job evaluation. This would facilitate supple- 
menting the 'approved programs' approach with examinations open to 
individuals who had not graduated from approved programs— a course of 
action already taken in some states. 

A representative of a teachers' union objected to a two-tiered system of 
certification on the grounds of unsound criteria for constructing on-the-job 
evaluation systems and the improbability of locating the requisite number of 
competent evaluators. Michael Rebell pointed out that relicensing involves 
the same sorts of considerations as a possible two-tiered licensure system and, 
despite its cogency, is quite as unpopular among practicing teachers and quite 
as problematic in light of the current weakness of the empirical base for 
evaluation . 

Someone wished to know if minimal qualification should be the only 
province of state licensure with maximal qualification {competency certifi- 
cation) left to employer hiring and promotion practices. Was it not in the 
interests of employers to hire the best qualified? Needless to say, some parti- 
cipants thought it might not be, given tight budgets and political problems. In 
essence, their grumbling could be interpreted as expressing the belief that 
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the public interest in quality schooling requires that state education depart- 
ments retain the authority to certify competence. 

The 'General v. Specific Dilemma' 

Actually, several dilemmas are encompassed under this heading. One 
participant described a bind state education departments face. If they are not 
specific enougli in their policies, they cannot be enforced or enforcement 
becomes arbitrary. If they are too specific, substantive due process or First 
Amendment 'freedom of expression' and 'pursuit of livelihood' issues arise. 
''We feel like we are walking a tightrope "-a classic inescapable dilemma of 
policymakers. 

Another critical area of policy decision-making involves general and 
specific abilities. Teachers are licensed to hold any number of jobs within 
their area of specialization. No one can calculate what specific demands will 
be placed upon a teacher in a given job. Participants wished to know the 
implications of this observation for the 'what,' 'when,' Svhere' and 'by whom' 
of licensure. They also wondered how this affects teacher program planning 
and approval. Should program approval only involve general abilities that 
would be required given a broad range of jobs in a field of specialization? 
Are there such things as general abilities? How context bound are abilities? 

These questions, of course, have been resolved in current systems of 
licensing. That they were raised reflects the power of the CBTE movement to 
force a serious re-examination of these fundamental issues. That no one at 
the conference had ready answers was a source of disappointment to some; 
but the willingness to confront the tough questions is, indeed, praiseworthy. 

The 'Common Culture v. Subculture Dilemma' 

Another difficult set of issues, tossed for the most part irto the lap of 
educators to resolve, has to do with cultural pluralism. From the perspective 
of teacher training, licensure, and employment practices, how shall it be 
accommodated? 

Someone suggested that answers might have to wait upon decisions as 
to how it is to be accommodated in the schools— decisions reflected in state- 
ments of educational goals. Someone else pointed out that it is presently 
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'accommodated' in teacher trainin.^, licensure and employment practices, is 
a subject of rather intensive criticism and re-examination, and that there is no 
reason for the CBTE movement to wait upon decisions from other sources. 
In other words, the participants seemed to believe there was no alternative 
to 'Valking out on a limb" and rejecting the status quo. 

Rebel] pointed out that issues of cultural pluralism are a significant 
locus of potential challenges to current licensing and employment arrange- 
ments. He mentioned problems in making the professional/paraprofessional 
distinction. The following brief scenario (constructed by Sheila HufO may 
help to clarify the point: 

To carry out its bilingual education program involving 
Puerto Rican children who could not speak English, given a 
shortage of certified professionals, men and women in the com- 
munity who spoke both English and Spanish in the Puerto Rican 
dialect were recruited. They were screened for linguistic ability, 
experience with children, and interest in teaching. After a short 
period where their performance was evaluated, they were issued 
provisional certificates. Later perfonnance evaluations attested 
to their competence. Schools of education began graduating suf- 
ficient numbers of trained professionals to perform the jobs held 
by people with provisional certificates. The paraprofessionals 
were told they must take a series of courses in an approved pro- 
gram and obtain regular certification in ovder to secure their 
positions. They challenge the requirement. 

A participant said that in his state, that presented no problem-that 
their licensure system was set up such that on-the-job evaluations, by super* 
visory staff, of teachers who had provisional certificates could deal with such 
circumstances. However, Rebell pointed out that such was not the case iri 
several states. He noted that moreover, existence of the option did not eli- 
minate the possibility of procedural irrationalities such as exemphfied in the 
case of one of his clients which was outlined eariier in the discussion. Further, 
the thrust of the CBTE movement seems to be headed in the direction of 
closing off existing alternative routes to certification. He underlined this 
trend as a potential source of litigation under Title VII. 

The scenario, in particular, has bearing upon CBTE insofar as its advo- 
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cates aspiie to closing ofT alternative routes to certification other than gradua- 
tion from approved programs. The likelihood of continuing teacher shortages 
in critical areas (a prominent current one being bilingual skills) renders such 
aspirations unrealistic. But more important is the observation that among the 
most competent practicing teachers are several who did not obtain certifica- 
tion through the traditional route. This fact casts doubt upon claims that the 
only route should be through approved CBTE training programs. This is 
especially true for the period in which the requirements of such programs 
have not been validated as related to effective teaching. However, even should 
there come a time when they are, it would remain an open question as to 
whether such programs are the only means to attain the competencies; and 
the policy question would remain as to whether or not, in the interests of 
fairness and quality schooling, there should be alternative routes to certifica- 
tion. 
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IIL CONCLUSION 



In closing the conference, it was agreed that there were, to be sure, no 
suiiple answers to the questions raised. All of the considerations voiced on 
various sides of the issues demonstrate the complexity of the problems 
involved in constructing sound, workable policies that promote quality 
schooling and encompass fair, rational employment practices. 

An important item on the conference agenda was to elicit from the 
states opinions on further work we might undertake on their behalf. There 
was a broad consensus that a training manual for state licensing authorities 
be prepared that would contain an overview and summary of the status of 
litigation and psychometric research relevant to teacher certification and 
that would also contain specific model procedures for establishing certifica- 
tion standards for use by state administrators. 
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Literature and Suggestions for Extending the Perspective," draft University 
of Texas, Austin (Fall, 1974). 
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sion of some of the more educationally relevant cases, may be found in Sheila 
Huff, "Credentialling by Tests or by Degrees: Title VII of the Civil Rights 
Act and Griggs v. Duke Power Company,"" Harvard Educational Review, 
Vol. 44, No. 2 (May, 1974). See also David M. White and Richard L. Francis, 
"Title VII and the Masters of Reality: Eliminating Credentialism from the 
American Labor Market," forthcoming in Georgetown Law Journal (Fall, 
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10. Washington y. Davis, 44 U.S.L.W. 4789 (June 7, 1976), 

11. Lesley Oelsner, op. cit. 

12. Post-conference developments in the Washington v. Davis case cast 
some doubt upon this earlier judgment. 

13. As pointed out in Michael Rebell's paper, even where it is not pos- 
sible to show adverse discriminatory impact, there is a growing trend toward 
a revitalization of the substantive due process concept that may lead a court 
to seriously consider a future claim of a plaintiff who alleges that he/she has 
been denied substantive right to pursue a teachin^^ career by an irrational 
credentialllng system. 

14. Chance v. Board of Examiners, 330 F. Supp, 203 (S.D.N,Y„ 1971), 
affd 458 F. 2d 1167 (2d Cir., 1972). 

15. Rubinos v. Board of Examiners, Civ. No. 74/2240 (S.D.N.Y. filed 
May 24, 1974). A decision is still pending in this case. 

16. It should be noted that no one at the conference had a naive view of 
'teacher effectiveness.' They realized that the notion was context bound- 
certain practices being appropriate in some circumstances and not in others. 

17. A rare example of such studies are those constructed by Frederick 
J. McDonald of the Educational Testing Service, Princeton, for the Beginning 
Teacher Evaluation Study being conducted for the California Commission for 
Teacher Preparation and Licenang and sponsored by the National Institute of 
Education. 

18. New York Board of Regents, "Statewide Plan for the Development 
of Post-Secondary Education," Unit 2 (1972). 
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OTHER BOOKS 



Study Commission on Undergraduate Education and 
the Education of Teachers 



I. Higher Education Refom 

1 . Toward a Community of Seekers- transcriptions from sessions of the 

Johnston College National Symposium on Higher Education. An appendix in- 
cludes names and addresses of people to contact at 267 experimenting college 
programs and related organizations. Discussants include Harold Hodgkinson, 
Frank Newman, Paul Dressel, and others. Basic to Higher Education reform, 
'75-'85. 

2. The Ranking Game: The Power of the Academic Elite- .a_critical look 

at assessments of higher education that are based on institutional reputation. 
Attack on the most influential rankings of higher education: Cartter,Roose- 
Anderson, etc. Discussion of the ways in which such reports are used and the 
impact of them on the homogeneity of graduate and undergraduate education. 
The authors are well known critics of Higher Education policy: Patrick Dolan 
and William Arrowsmith. 

3. Nothing But Praise: Thoughts on the Ties Between Higher Education 

and the Federal Government- looks at reforms in the process of grant- 
ing federal money to institutions of higher education, to state agencies, and to 
schools. A critical appraisal of the total federal posture toward higher educa- 
tion and education in general. 

4. Of Education and Human Community— essays on education and the 

con>rriMv/.fy"building process. Also includes an edited discussion among leaders 
t'NVjeC'iVnental education. Discu'js^ir^ts include Harold Hodgkinson, Sam 
. '>.!i;-cirs, Irwight Allen. Harvey ocribner and the like. 

5. Open Admissions: The Promise and the Lie of Open Access in Amer- 
ican Higher Education— essixys on access in the state higher education sys- 
tems of Nebraska and California and the City University of New York. The 
book says a lot about the background of the current debate on open admission 
in New York City and elsewhere. 

6. A Time Half Dead at the Top: The Professional Societies and the 

Reform of Schooling in America 1955-I975— an examination of 20 
years of discipline-oriented "professional society" work with education reform 
in the schools and higher education. A strong criticism of the role of the pro- 
fessional societies and accrediting-Iicensing agencies in the sliaping of higher 
education. 

7. Forms and Formulations of Education- several studies of how educa- 
tion reform is conducted in terms of various explanation-logics and the possi- 



157 




bilities and limitations of such reform viewed from the perspective of theory* 
construction. 

8. Some New Ways of Learning and Teaching- brief descriptions of ex* 

perimental teacher education programs throughout the U.S. Includes sections 
on minority institutions, free schools, alternative public schools, community 
education, metropolitan public colleges and women's studies programs. 

II. Sexism in Education 

9. WeV Do It Ourselves: Combatting Sexism in Education — an analy* 

sis of sex role channelling and stereotyping with numerous alternative action 
outlines. Combines both feminist and gay perspectives with blueprints for 
creating women and gay studies centers, legal and medical clinics and day care 
services. Also a resource directory. 

10. Badges and Indicia of Slavery: Cultural Pluralism Redefined- ti look 

at some of the social, economic, and legal implications of pursuing a policy 
of cultural pluralism. Includes site visits to traditional anf^ alternative institu- 
tions and some perspectives on sexism in relation to cultural pluralism. 

1 1 • Mini-Manual For a Free University- guide for setting up autonomous, 

student-run education projects. Several case studies are included, with a re- 
source guide listing hundreds of groups, individuals, projects, and publications. 
The resource guide includes a number of listings of women's resource material 
centers, centers for combatting sexism, etc. 

12. Some New Ways of Learning and Teaching- brief descriptions of exper- 
imental teacher education programs throughout the U.S. Includes sections on 
minority institutions, free schools, alternative public schools, community edu- 
cation, metropolitan public colleges and women's studies programs. 

III. Black Education 

13. Education By, For and About African Americans: A Profile of 

Several Black Community Schools- profiles of nine independent and 
qommunity-based black schools from pre-school levels to the community col- 
" legeMevel. Helpful to people who want to build their own black community- 
based school. 

14. Badges and Indicia of Slavery: Cultural Pluralism Redefined- 7i look 

at some of the social, economic, and legal implications of pursuing a policy of 
cultural pluralism. Includes .site visits to traditional and alternative institutions. 
Includes site visits and reports on a number of black community-based 
schools. 

IS. Mini-Manual for a Free University- zu\(Xq for setting up autonomous, 
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student-run education projects. Several case studies are included, with a re- 
source guide Usting hundreds of groups, individuals, projects and publications. 
Resource directory includes listings of a number of black and pan-African 
organizations and resource centers. 

1 6 . Equality of Opportunity in Higher Education: Myth or Reality ?- by 

Paul Mohr. Essays by Mary Lepper, Sam Wiggins, Terry WUdman and Paul 
Mohr on how black colleges are surviving or being destroyed under present 
state plans. 

\1, Black Colleges and Equal Opportunity in Higher Education- by 

Paul Mohr. An analysis of plans and lack of planning for black colleges in Mis- 
sissippi, Maryland, Tennessee, Florida and elsewhere. 

18. The University Cant Train Teachers- a group of prominent school ad- 
ministrators talk about school-based training for future teachers and about 
how certification, accrediting, tenure and funding problems affect change in 
teacher education. Includes extensive useful discussions by Barbara Sizemore, 
former superintendent of schools in Washington and in Woodlawn, Chicago. 

IV. Chicano Education 

^19. The Recruitment, Channeling, and Placement of Chicano Teachers- 

a discussion and resource list related to the recruiting of Chicano teachers. 

20. Chicano Alteirnative Education- this book is divided into three sections. 
The first section consists of an essay "Chicanos and Schools: A Perspective 
for Chicano Alternative Educational Situations" by H. Homero Galicia. It 
presents a conceptual discussion of the shortcomings of schooling in this soci- 
ety and a profile of four different Chicano alternative educational efforts, ^^'ith 
brief analytical comments on these alternatives. The second section "Alterna- 
tive Chicano Educational Programs in California'' by Clementina Almaguer. 
contains a listing and summary description of seven alternative Chicano 
schools. The final section contains the actual transcripts of the interviews by 
Gementina Almaguer with personnel from the following seven programs: 
Oakland Street Academy (Oakland), Case de la Raza (Berkeley), Escuela del 
Barrio (San Jose), Colegio de la Mission (San Francisco), Universidad de 
Aztlan (Fresno), Huelga School (Deland), and D-Q University (Davis). These 
interviews contain very useful insights into the problems and processes en- 
countered in attempting to create alternative schools. The book contains 
graphics by Ralph Maradiaga, co-director of Galeria de la Raza in San Fran- 
cisco. 

21 . Casa De La Raza- subtitled "Separatism or Segregation, Chicanos in Public 

Education,** this book is essentially a case history on the educational and 
legal issues surrounding the decision by the Office of Qvil Rights of the U.S. 
Office of Education to close down Casa de la Raza. Tlie implications of this 
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case arc of significance to all Chicano and other ethnic-based educational 
programs throughout the nation. This is ai, extensive and thorough case his- 
tory, complete with a chronology of the case, description of the program, 
correspondence and memoranda from the Office of Civil Rights, the Berkeley 
school^ superintendent anrt ^r:^M experts; a highly competent and detailed 
article by Susan F. A-^l ^.r- is reprinted from the California law Review. 

?.2. Parameters of Institutional Change: Chicano Experiences in Educa- 
tion— contains a section of case histories of Chicanos who attempted to pro- 
duce change within educational institutions and describes limitations of those 
changes. Reconstructed from interviews, the eleven case histories that are 
presented in this book are: East Los Angeles Blowouts; A Biliiigual/Bicultural 
Attempt in Sil/er City; El Paso Educarional Research Project; Chicano Student 
Movement at San Jose; Chicano Demonstrations at New Mexico Highland Uni- 
versity; Before Universidad de Aztlan: Ethnic Studies at Fresno State College; 
Memoirs of a Chicano Administrator; The Struggle for Third College at UC 
San Diego; Casa de la Raza; The Intrigues of Educational Vouchers: Schools 
and Parents; and the Alum Rock Voucher Program. .Also included is a section 
of conceptual essays that extend the argument made by the case histories. 
These latter essays suggest a mode for analyzing and drawing lessons to be 
learned posed by the case histories presented in the first section. The essays 
presented are ^'Cultural Pluralism and the History of Urban Educarion: Cen- 
tralization, Decentralization, and Community'' CASTANEDA PANEL; 
"Schooling of Chicanos in a Bilingual, Cn't 'illy Relevant Context'' REY- 
NALDO FLORES MACIAS; "Cultural N'-aa'ality in Education: Some Legal 
Developments and Their Possible Impact on the Future of Education" LAW- 
RENCE FREEMAN; "To Leave to Hope or Chance: Propositions on Chicano 
Studies" JUAN GOMEZ-QUINONES; "Fiesta of Life: Impressions of Paulo 
Freire" E.A. MARES; '^Education Under Capitalism-A Bibliography" 
CARLOS VASQUEZ. 

23 . Badges and Indicia ofSlaver}>: Cultural Pluralism Redefined-thc ide- 
ology of cultural pluralism plus site visit reports on Chicano institutions. 

24. Educacion Altemativa-How to organize a Chicano Alternative School by 

people who have done it. 

25. Mini-Manual For A Free University -includes listings and descriptions of 

a number of Chicano and Latin American resource and research centers. 

V. The Education of Teachers 

A. Higher education position on educating teachers: 

26. Education for J 984 and After-CoWcge of Education leaders discuss tar- 
geted education for teachers, cultural pluralism and other topics. Discussants 
include George Denemark, Vito Perrone, Alfredo Castaneda, Dean Corrigan, 
Jos'" Goldsmith, Jake Carruthers and others. 
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27. The Supply and Demand of Teachers and Teaching-ihc present 

perception of teachers as * 'single-purpose tools" rather than as professionals 
who are capable of working in a variety of situations increases the disparity 
between supply and demand. Provides suggestions toward a model for exam- 
ining manpower problems. 

28. The Future: Create or Inherit- a study of changes occurring in the 

schools as a result of the "knowledge explosion." What happens to teacher 
training when teachers begin to take on new roles in the schools and com- 
munities? Includes essays by such futurists as Harold G. Shane, Robert 
Bundy, Charles W. Case, W. Timothy Weaver; also conversations with Harold 
Garfinkel, Robert Bundy, Diaries W. Case and others. 

29. Manpower Newsletter-coni^ims manpower information data on teachers 

and on various states' efforts to assess and deal with needs and surpluses. 
Presents some teacher education manpower data models. 

30. Statistics Newsletter-coniaixt's a re-analysis of the Carnegie Commission 

survey data on higher education which covered 70,000 undergraduates, 
60,000 faculty members and 33,000 graduate students. 

31. Choices- list of alternative and experimental programs in one state: 

Vermont. "A model catalogue. 

B. School-based positions on educating teachers: 

32. What is SchoolConmunity-Based Teacher Education and Why 

Should School Administrators Be Interested In It?- questions and 
answers about school-community-based teacher education prepared after site 
visits to teacher centers, schools-without-walls, arid other community- 
oriented programs. 

33. The University Can't Train Teachers-^ group of prominent school ad- 
ministrators talk about school-based training for future teachers and about 
how certification, accrediting, tenure and funding problems affect change in 
teacher education. Discussion leaders include Dick Foster, Bud Spillane, 
Barbara Sizemore, Jose Cardenas, Bob Schwartz, and others. 

VI. Manpower 

34. The Supply and Demand of Teachers and Teaching- the present per- 
ception of teachers as '*singIe-purpose tools" rather than as professionals 
who are capable of working in a variety of situations increases tlie disparity 
between supply and demand. Provides suggestions toward a model for exam- 
ining manpower problems. 

35. Adjustments of Colorado School Districts to Declining Enroll- 

we/7/S^tatistical summaries of decliniiig districts and several case studies 
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axe included m this book. Introduction by Kenneth Boulding, the well- 
known economist. Studies by Mark Rodekohr. 

36. Manpower Newsletter— contains manpower information data on teachers 

and on various staters efforts to assess and de2l with needs and surpluses. 
Presents some teacher education manpower data models. 

VIL Legal Issues in Accreditation, Credentialling and Certification 

37. Teacher Credentialling Reform in New York State: A Critique and 

A Suggestion for New Directions- the impact of teacher credentialling 
laws falls far short of the ideal for which they were established. The author 
argues that these laws "don't protect children from incompetent and uniit 
teachers." He suggests that improvements in the system can be perfected, 
school boards shov-ld be granted the authority "to hire any college graduate 
with relevant subject *nattrr preparation and to require such districts to seri- 
ously and systematically assess his performance once he is on the job.** 

38. Basic Legal Issues in New York State on Teacher Certification- 
deals with the function of government in the professional licensing or certi- 
fication of educators. The basic argument of the book is that **the right and 
responsibility of the state to certify teachers is a legitimate, moral, and 
rational use of the political power of the stale, only to the extent that teach- 
er certification protects and promotes some demonstrably legitimate public 
interest of the people for whose welfare and benefit state accredited schools 
axe established." 

39. Teacher Education in the United States: The Responsibility Gap- 

the Study Commission's final report. Chapter topics include: (1) The Future 
of Schools and ChflUren-Education of Teachers as a Community Activity, 
(2) Teacher Education in America Now, (3) Legal Constraints: Licensing, 
Accreditation, and Equity in Teacher Education, (4) Gathering Information 
on the Process of Educating Teachers, (5) The Federal Role in Teacher Edu- 
cation. Available, $3 per copy. Chapter III is the final Commission statement 
on licensing and accreditation in general and in teacher education areas. 

VIIL Indian Educadon 

40. Badges & Indicia of Slavery: Cultural Pluralism Redefined-the ide- 
ology ot cultural pluralism plus site visit reports on new Indian institutions. 

41. Teacher Education in the United States: The Responsibility Gap- 

includes consideration of special Indiu.i concerns as regards licensing, accre- 
ditation, new sorts of institutions, and planning for the future. "This report 
should, and we believe will, become the basis for a profound examination of 
our ryrrent educational system, and its recommendations, above all, should 
be taken seriously.'* . . . WASSAJA, March, 1976. 
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IX. Power Structure Analysis 



42. Ho\\^ to Research the Power Structure of Your University or 
College 

43. How to Research the Power Structure of Your Secondary School 
5ysrew- research outlines for finding out how decisions are made in these 
two educational communities. Tliese books frame questions, provide proba- 
ble sources for finding answers, contain case studies, and offer bibliograph- 
ies- They are intended to be used as workbooks. 1973. 

44. Wheeling dc Dealing in Washington: A Student's Guide to Federal 
Educational Politics and Resources- ih\s guide gives practical informa- 
tion on lobbying, shows studies on student financial lid and sexism in edu- 
cation and has a resource directory of congrcssionai committees, federal 
and private agencies relating to educational issues. 1975. 



These books can be ordered from: 

University of Nebraska 
Nebraska Curriculum Development Center 
Andrews Hall 
Lincoln, Nebraska 68588 

All book:; are S2 each except Teacher Education in the United States: The 
Responsibility Gap which is S3. Please make checks payable to University 
of Nebraska. 
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Ho\\f can the performance of teachers he more fairly, legally, and 
adequately evaluated? or //oiv should one evaluate teacher 
competence? 

How might the state best assure qualify teacher preparation 
programs? 

Sheila Huff, Report of the Special 
Legal Issues Conference, December, 
1975--Denver, Colorado 



The essays in this book evolved from the groundwork laid at a 
legal issues conference in December, 1975, sponsored by the 
Multi-State Consortium on Performance-Based Teacher Education. 
Attending that meeting were staff from state departments of 
education and their legal advisors, teacher union representatives, 
faculty of schools of education, members of the research and 
development community, lawyers representing the interests of 
parents and students-a wide spectrum of individuals with a 
stake in decisions made regarding accrediting and licensing issues. 
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